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ABSTRACT 


This research investigated the development and use of an analytical assessment 
methodology anchored in systems engineering principles, affordance theory, and human 
abilities, to measure the potential of integrated training environments (TTEs) to 
effectively support training. Empirical investigation of ITEs is costly, lacks formal 
guidance, and is therefore often unreliable. Ad hoc studies, commissioned by individual 
organizations, constitute the current state of Army ITE evaluation. These assessments are 
often entirely based on subject matter expert judgment through surveys, which produce 
results that are linked indirectly and loosely to the TTEs. What is required is a repeatable, 
inexpensive, analytical approach to ITE assessment that bounds the potential of a given 
system to the support it provides to the deliberate practice of specific tasks. The results of 
this research include the development and use of the integrated training environment 
assessment methodology (ITEAM). ITEAM was used to evaluate the ability of several 
ITEs to support the deliberate practice of specific tasks during training. The dissertation 
shows that ITEAM consistently predicted where training was supported by an ITE and 
generally how well. ITEAM is offered as a tool to be used early in the acquisition process 
to affordably define and verify the requirements of candidate ITE solutions for 
Department of Defense needs. 
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EXECUTIVE SUMMARY 


This research effort focused on the investigation and development of an analytical 
assessment methodology to support the evaluation of human in-the-loop (HITL) 
simulations also known as Integrated Training Environments (ITE). Sometimes referred 
to as training estimation models, analytical methods of assessing ITEs attempt to use 
mission related tasks, operational concepts, and defined standards of execution to 
investigate and answer questions about TTE cost and effectiveness. This is done in an 
effort to avoid the expense of executing empirical transfer of training (TOT) studies. The 
Integrated Training Environment Assessment Methodology (ITEAM) differs in its 
perspective and approach. ITEAM was developed partially in response to the elimination 
of the Army’s Training Effectiveness Analysis (TEA) system and with the view that 
empirical assessment techniques (mainly TOT studies) are cost prohibitive and limited. 
ITEAM is a human-focused, systems-engineering approach to ITE analysis. ITEAM 
leverages lessons learned from the literature pertaining to training as well as human 
ability research and affordance theory. In the ITEAM approach, ITE assessment is 
conducted systematically following a set of processes (Eigure 1). Eor practical purposes, 
an ITE is defined as any human in-the-loop training system that includes live, virtual, 
constructive or game-based training aids, devices, simulators, or simulations (TADSS) 
alone or in combination, used to support the deliberate practice of skills for defined 
mission tasks. 
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Figure 1 Integrated training environment assessment methodology (ITEAM) 


The assessment process starts with defining the specific need for the ITE in the 
form of training outcomes. Once the need is defined, an operational concept of how the 
user views employment of the TTE is explored and developed. This step provides insight 
into the types and kinds of training that the user envisions conducting within the ITE. 
Next, a series of job/task analyses (JTAs) are conducted to describe the activities that will 
be practiced within the ITE. JTAs are noted in the literature as a major area of neglect 
during ITE analysis. Once completed, the JTAs are annotated with the human abilities 
(HA) associated with each of the tasks and task elements. This step is the first unique 
aspect of ITEAM. HA, were developed by Eleishman & Quaintance (1984) as part of a 
taxonomic effort to define human performance and work. HA provide a way to look at 
the ITE in human terms (e.g., physical, sensory, psychomotor or cognitive abilities) 
instead of technical terms. Once HA are mapped, the analyst is able to describe and 
define the affordances for both the real world and the ITE. This step is the second unique 
aspect of ITEAM. Affordances are the items that are necessary within the ITE to 
stimulate the human abilities of the trainee. Affordances are most often viewed using the 
lens of fidelity. However, determining ITE utility based solely on fidelity has been 
identified as problematic within the training and expertise literature. 
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ITEAM is a type of training estimation model. The goal of this effort was to 
develop an analytical assessment methodology that is able to predict task elements within 
an ITE with a high likelihood of positive transfer of training (TOT) to the real world. 
Predicting those task elements improves our ability to design and build better ITEs. 

Three studies were conducted during this research. Each study re-evaluated a 
previously and independently conducted empirical training effectiveness analysis (TEA) 
of an TTE to determine if ITEAM could predict elements with high probability of positive 
transfer. The main result of this research revealed that an analytical assessment 
methodology based on human abilities and affordance theory can be used to predict areas 
where positive training transfer is most likely to occur. Additionally, results supported the 
belief that domain subject matter expertise is necessary when conducting ITE assessment 
but that expertise is only useful when it is applied where it truly exists. Since ITEAM 
does not attempt to determine appropriate levels of fidelity for ITE affordances, it cannot 
be relied upon to answer questions about how much stimulus is necessary for a given 
task. It only provides insight as to whether or not specific affordances are necessary and 
available. With that information, a generalized rating of ITE support for the practice of a 
specific task is provided. Enhancement work is needed in the scoring area to provide 
emphasis on critical TTE affordances. This research approached all affordances as being 
equal. The reality is that some tasks are more important than others and therefore some 
affordances are more important than others. ITEAM would benefit from the incorporation 
of a mechanism to reflect stakeholder value with respect to affordances. Einally, taking 
the time to conduct a thorough front-end analysis that identifies what is and is not needed 
in an ITE is of great value. If done correctly, it results in specifications of ITES where we 
have real confidence in the ITEs ability to support training. 
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I. INTRODUCTION 


A. A STORY TO SET THE STAGE 

The intent of this dissertation is to highlight the need and develop a process for a 
reliable method to determine integrated training environment (ITE) utility in a cost 
effective manner. In August of 2012, the United States Army (USA) fielded the first 
installment of the dismounted soldier training system (DSTS) to FT Benning, Georgia. 
The DSTS, developed by Intelligent Decisions Inc., was described in a Defense News 
article as “a squad-level training tool that lets soldiers practice major combat operations 
and irregular warfare in a virtual world. The system includes a head-mounted display, full 
suit, replica weapon, sensor system and wearable computer pack” (Biron, 2012, p. 30). 
According to the article, the DSTS passed USA testing and evaluation at Fort Benning, 
Georgia. 

The Army’s tool for conducting training system analysis was called the Training 
Effectiveness Analysis (TEA) System. Until recently, the agency responsible for 
conducting TEA was the Training and Doctrine Command (TRADOC) Analysis Center 
(TRAC) located at White Sands Missile Range (WSMR), New Mexico. Due to budgetary 
issues, TRAC-WSMR was forced to eliminate the division responsible for conducting 
TEA sometime around 2010. By regulation, TEA studies were conducted during the 
various phases of the material acquisition process (MAP) coinciding with major 
milestones. Post-fielding TEA (PFTEA), which normally occurs after a training program 
has stabilized, is one of several forms of analysis that no longer receive supervision. 

The demise of the TEA system should be disturbing for the ITE consumer and 
raises important questions. If the organization (people and policy) designated to guide the 
conduct of TEA was not involved in the DSTS assessment, how do we know if the TEA 
was done correctly? Should we trust what the TEA told us? More importantly, how do we 
know if the DSTS is effective? This example is one that may be used to illustrate the 
problems associated with training effectiveness analysis. 
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B. INSIGHT INTO THE CULTURE OF ARMY TRAINING 

When Soldiers are not training for war, they are engaged in one. As an institution, 
the Army has been training since 1775, and militias were drilling prior to that. Training is 
at the core of a soldier’s life. Careers are punctuated by deliberate practice of skills and 
the continuous exercise of abilities during daily activity or formally planned exercises. 
Leaders recognize the need to maintain and increase the knowledge, skills and abilities of 
their soldiers if they are to maintain a decisive edge over various threats. Training 
management and execution within the Army has evolved over time and along with the 
technology that supports it. Figure 1 depicts the Army training management model, 
which is a continuous process driven by commanders as they evaluate the mission, 
develop plans to train for the threat, and assess performance based on defined training 
objectives. 



Figure 1. Army training management model (from Department of the Army, 2011) 

Commanders follow guidance and orders. They are responsible for ensuring that 
their units are trained and ready for war. Guidance and orders come from higher 
authorities. Commanders are responsible for synthesizing the complex operating 
environment, strategic guidance, and orders into coherent training plans. Part of the 
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synthesis results in a hierarchical task list of collective and individual tasks that are both 
critical and non-critical. The process to develop the task list is sometimes referred to as a 
mission essential task list (METL) crosswalk. The METE crosswalk provides traceability 
for the commander and higher leaders on how the unit will prepare for specific 
contingencies. 

In the Army, we place responsibility for training execution on our warrant officers 
(WO) and non-commissioned officers (NCO) with the understanding that the ultimate 
responsibility for unit readiness remains with the commander. Our field manuals and 
strategic documents reinforce this situation stressing the importance of the commander’s 
visualization and participation in the development and execution of training. The reality 
is that few if any of our commanders, WOs or NCOs are formally educated in 
instructional systems design (ISD) or the systems approach to training (SAT). At best, 
they are introduced to the Army’s training management model during their basic school 
training. That introduction emphasizes the utilization of METE, combined arms training 
strategies (CATS) and training and evaluation outlines (TEO) to structure and evaluate 
soldier training and performance evaluation (Department of the Army, 2011). 
Commanders over-rely on NCOs and WOs as their primary trainers based on an 
assumption of their expertise. Our culture supports this assumption and resists any 
attempts to change or negate it. As a result of the culture, the Army’s problems with 
expert overconfidence are exacerbated (Hubbard, 2009). 

Officers, WOs and NCOs may be expert soldiers, but they not necessarily expert 
trainers. Some receive specialized training or education that better prepares them for the 
role of expert only in their military occupational specialty (MOS) or branch. This 
situation is the exception not the rule and generally the increased skills and knowledge 
acquired have negligible impact on their knowledge of training. As a result, the Army has 
flawed expectations with respect to training program effectiveness and ITE assessment. 

C. DISCUSSION OF THE PROBLEM 

The value of human in-the-loop (HITE) simulation training primarily comes from 
it’s ability to offer practice opportunities in environments that replicate important features 
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of the real world (Salas, Rosen, Held, & Weissmuller, 2008). At some point the focus on 
requirements determination, definition, and solution development for military ITEs 
shifted focus away from human performance and skill acquisition towards advanced 
technology. SME participation in ITE design and an overt focus on device fidelity has 
further exacerbated the problem. Operational and system requirements documents 
(ORD/SRD), produced as part of the Joint Capabilities Integration Development System 
(JCIDS), have driven increasing focus on the technological aspects of possible ITE 
solutions while marginalizing the importance of training program effectiveness. The 
common practice now is to provide the technical requirements specifications for training 
systems to defense contractors (the what) and then require the defense contractor to 
provide the government with a detailed explanation of how the training systems will 
support the user (Klein, Johns, Perez, & Mirabella, 1985). Some people view that as the 
antithesis of what is inherently governmental and contractually obligated within the 
acquisition system. We (government) should be describing the desired outcome (trained 
personnel) and leaving the exact specification of a solution (the what) to the contractor. 

Research in ITE development provides insights into the challenges faced by the 
training developer (TD) and material developer (MD), and how time has turned a logical, 
deliberate and well-meaning analysis process into just another check-the-block event. 
Kane and Holman cited in Hays & Singer (1988) refer to the situation where people 
involved in the training development process are more focused on paperwork than the 
substance of the paperwork, as “the pass through problem.” A commonly reiterated 
theme on the lack of front-end analysis is found throughout the academic and military 
research literature. Abiding by the letter of the law literally, has become more important 
than executing the due diligence of analysis ensuring that requirements are accurate, 
effective and efficient. At the executive level, the training development process has 
become overly focused on proper briefings, timelines and budgets. 

Between conflicts, the Armed Eorces rely on ITEs to maintain warfighting skills. 
Integrated training environments are where Soldiers, Sailors, Airmen and Marines 
practice the skills and engrain the knowledge necessary to execute their combat missions 
successfully on the battlefield. ITEs are extremely resource intensive and are rarely 
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described as lightweight or turnkey. ITEs require verification, validation and 
accreditation (VVA) just as their analytical counterparts that support budgetary and force 
structure decisions. A major difference between the training aids, devices, simulators and 
simulations (TADSS) that support ITEs and other types of simulations, is how they are 
evaluated. 

Traditionally, researchers have attempted to assess the value of training 
simulations and training enablers using empirical means such as transfer of training 
(TOT) studies. The literature reveals that both laboratory and applied experimentation in 
the form of TOT studies suffer from many difficulties that makes relying on them 
potentially problematic (Milham, Carroll, Jones, Dean, & Chang, 2008). TOT studies 
become very difficult to execute during periods of decreased resourcing, and they often 
focus on the physical fidelity of an ITE compared to its operational counterpart 
(Burnside, 1990; Sticha, Campbell, & Knerr, 2002). Sometimes functional and 
psychological fidelity are considered when investigating the cognitive support a training 
system provides, but this occurs less often. More frequently, TOT studies are 
characterized by the use of subjective survey data and advanced statistical techniques that 
are used to create support for weak inferences made concerning system utility. 

Researchers have attempted to develop ways to evaluate training programs and 
systems using non-empirical means in an effort to reduce costs and accurately capture 
positive system attributes (Gilligan, Elder, & Sticha, 1990; Keesling, King, & Mullen, 
1999; Sticha et ah, 2002; Tufano & Evans, 1982). Despite their best efforts, only a 
handful of researcher’s techniques have been successfully implemented outside of the 
research arena. Eew of the implementations have been used more than a handful of times. 

The formal training effectiveness analysis (TEA) system within the USA 
officially ended in summer 2012 (Drillings, 2013). The TEA system was the Army’s 
means of guiding the assessment of training programs and devices in support of the 
material acquisition process (MAP). With the demise of the TEA system no formal policy 
or directed methods exist for guiding ITE assessment. 


5 



D. RESEARCH APPROACH 


The methodology developed in this dissertation can be classified as a training 
estimation model. As described by Muckier and Finley (1994) training estimation models 
are mainly for evaluating training system designs and are design tools that allow for a 
level of prediction of training success before system development. We take this a step 
further and assert that this estimation model may also be used as a guide to evaluate ITE 
utility. Training system estimation models allow for analysis of alternatives that may be 
developed through the instructional systems design (ISD) process. We acknowledge that 
estimation models have layers and that this research effort only addresses some of them. 
The future work section points out areas and actions that should be examined in order to 
continue the refinement of this methodology. 

The focus of this dissertation is on assessing the utility of ITEs to support the 
deliberate practice of tasks and skills involved in military training. Eigure 2 depicts the 
logical process taken during this research. Every research effort is guided by questions, 
assumptions and a hypothesis. The hypothesis for this research effort is that an analytical 
assessment methodology based on human abilities and affordance theory can predict task 
elements within an integrated training environment with the highest likelihood of positive 
transfer of training. 
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Figure 2. Pictorial representation of dissertation research process 


The first step of this process identified training simulation programs to serve as 
case studies. TEA had been previously conducted on these systems so they could be used 
for comparison with the analytical technique developed as part of this research. Once 
candidate systems were identified, TEA studies were obtained and sanitized by removing 
the study results and data. This process was executed before we began our assessment 
approach to prevent the corruption of our results. Once stripped of data and results, we 
parsed each TEA to identify learning objectives, training task requirements and any other 
information needed by our methodology. Next, we conducted a task analysis on the 
mission and task data derived from each TEA study. The TA was done to the level of 
detail necessary to support the identification of the real world human abilities (HA) and 
real world affordances. A similar process was conducted to identify the human abilities 
and affordances that the subject ITE supported and contained. Once the real world and 
ITE HA and affordances were listed a scoring process was applied to determine a 
measure of how well the ITE could be expected to support the practice of the identified 

tasks. The results of this activity identified strengths and weaknesses in the studied ITEs. 
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Formali z ation of the process provides the description of the Integrated Training 
Environment Assessment Methodology (ITEAM). Results from the ITEAM assessments 
were compared to the results of the government TEA studies to demonstrate the 
predictive value of the analytical assessment methodology. 

E. CLARIFICATION OF TERMS 

Words have specific meanings and when used inappropriately they confuse and 
lead to a poor understanding of a situation. The words model, simulation, simulator and 
modeling and simulation have been used interchangeably to mean the same or drastically 
different things. As evidenced in the next chapter, these words have different meanings 
when used in different contexts. To provide the reader with the necessary perspective to 
understand our point of view, the following definitions are provided. 

• Model: A physical, mathematical, or otherwise logical representation of a 
system, entity, phenomenon, or process (Under Secretary of Defense, 
1998). 

• Simulation: A method for implementing a model over time (Under 
Secretary of Defense, 1998). 

• Simulator: A device that duplicates the essential features of a task 
situation and provides for direct human operation (Under Secretary of 
Defense, 1998). 

• Fidelity: The degree of similarity between the training situation and the 
operational situation, which is simulated. It is a two dimensional 
measurement of this similarity in terms of the physical characteristics and 
the functional characteristics within the environment (Hays & Singer, 
1988). 

• Integrated Training Environment: Any human in-the-loop training 
system that includes live, virtual, constructive or game-based training aids, 
devices, simulators, or simulations (TADSS) alone or in combination, 
used to support the deliberate practice of skills for defined mission tasks 
(Hodges, Darken, & McCauley, 2014). 

F. DOCUMENT ORGANIZATION 

Chapter I introduces the problem and provides the reader with an example placed 
in context designed to stimulate thought about the problem. The chapter describes the 
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research approach to be used in the dissertation. It also, provides clarity on several terms 
that will be seen and used throughout the dissertation document. 

Chapter II discusses the literature within the problem domain. The chapter 
includes a review of front-end analysis including task analysis, human ability analysis, 
fidelity, affordance theory and transfer of training. Verification and validation, the 
impacts of subject matter experts, various forms of simulation assessment, and the USA 
training effectiveness analysis (TEA) system also are covered. 

Chapter III introduces and discusses the integrated training environment 
assessment methodology (ITEAM). 

Chapters IV, V, and VI describe case studies where ITEAM was used to assess 
the utility of three ITEs. The results of the ITEAM assessments and previous TEAs are 
compared to demonstrate ITEAMs ability to analytically predict the utility of the ITEs for 
the deliberate practice of specific tasks. 

Chapter VII provides a discussion on the application of ITEAM and the overall 
results and impressions obtained from using ITEAM as an ITE assessment tool. 

Chapter VIII provides the conclusions from the research and recommendations for 
future work to extend and improve on ITEAM. 
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II. LITERATURE REVIEW 


The focus of this dissertation is on assessing the utility of an integrated training 
environment (ITE) (i.e., how well does an ITE support the deliberate practice of skills 
necessary to accomplish specific tasks at the human ability level?). In order to assess an 
ITE’s utility, several things must be considered: (1) the need, operational concept and 
functional allocation for the ITE (2) the intended leaming/training objectives for trainees 
(3) the tasks that support those learning/training objectives and (4) the standard for 
performance. Eigure 3 depicts just a few of the factors that impact the assessment of 
training simulations. 

This literature review opens with a discussion about front-end analysis to include 
capabilities based assessment (CBA). CBA acts as our entry point into ITE development 
and is found within the boundary of the Joint Capabilities Integration and Development 
System (JCIDS). The discussion on CBA is followed by a discussion of the literature 
dealing with learning and performance objectives, task analysis (TA), human abilities 
(HA), fidelity, affordance theory and transfer of training (TOT). Einkages between TA 
and HA, affordance theory and fidelity are provided. Erom there the focus shifts briefly to 
the subject of verification and validation (V&V). Similarities between validation and 
other forms of assessment are mentioned. A brief review of the impact of subject matter 
experts (SME) precedes the section pertaining directly to analytical simulation 
assessment methodologies. That review is followed by an introduction and overview of 
the USA TEA system. The chapter concludes with a brief summary of all of the material 
discussed. 
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Figure 3. Considerations when dealing with simulation assessment 


A. FRONT-END ANALYSIS 

Front-end analysis includes those activities necessary to define and describe the 
training problem and the supporting solution attributes prior to the development of any 
technical system specification and requirements documents. When discussing front-end 
analysis, we focus on those activities that support the definition of training solution 
function without regard for the training solution form. Training solution form should 
always follow function, however, as we will learn, in practice that is not always the case. 

Many considerations must be addressed when developing a training program or 
device (e.g., the purpose of the training device; the trainee population; the time allotted 
for training; the tasks to be trained; the training objectives that specify the level of 
transfer required; the monetary costs associated with various design alternatives; and 
often, the engineering state of the art) (Cream, Eggemeier, & Klein, 1975; Hays & 
Singer, 1983; Muckier & Finley, 1994a; E. Salas et ah, 2008; Eduardo Salas & Cannon- 
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Bowers, 2001; Smode & Hall, 1975). These items reside within the analysis and design 
of training stages of instructional systems design (ISD). They should be aligned with the 
analysis phase of the JCIDS process known as CBA. 

1. Capability Based Assessments 

The Department of Defense (DOD) utilizes JCIDS as the systematic means of 
analyzing and determining capability based requirements and solutions applicable across 
all services. JCIDS begins with a stakeholder need that identifies a perceived gap in 
operational capability. From this need follows a series of assessments. The assumption 
until now has been that the CBA process works to provide the maximum amount of detail 
needed to feed the larger JCIDS process in an effort to determine the best capability 
solutions possible. However, published documentation leads us to a different conclusion: 

The preference is to avoid high rigor and time-consuming detail in the 
CBA, and concentrate on whether to recommend action. CBAs that are 
tightly focused on recapitalization, replacement actions, evolutionary 
needs, or information systems should take no more than 90 days, while 
more complex CBAs dealing with large uncertainties should take no more 
than 180 days. (Training and Doctrine Command, 2011, p. 64) 

The preference is for CBA to be a “quick and dirty” process that merely makes the case 

for a procurement or development project. There is no expectation or desire for CBAs to 

be full-scale analyses that crisply define requirements or gaps to be filled. 

Development of simulation-based training devices often takes years with 
production taking longer. Yet, the initial front-end analysis essential to support their 
development is required to be completed in 180 days or less. This is not just a USA 
policy—rather it is one dictated within the JCIDS regulations as well. This time 
compression has led some to suggest that conducting assessments early in the 
developmental lifecycle is infeasible unless the requirements document process 
undergoes revision (Tufano & Evans, 1982; Wheaton, Rose, Fingerman, Korotkin, & 
Holding, 1976). CBAs are composed of several sub analytical steps, namely the 
functional area assessment (FAA), the functional needs analysis (FNA) and the functional 
solution analysis (FSA). Guidance for much of the front-end analysis for training system 
design is provided in the MIF-HDBK-29612-2A Department of Defense Handbook, 
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Instructional Systems Development/Systems Approach to Training (ISD/SAT) and 
Education [Part 2 of 5] (Department of Defense, 2001). 

Reviews of recent CBA documentation (i.e., FAA, ENA or ESA) demonstrate the 
importance of explicitly aligning perceived capability gaps with joint and strategic 
guidance priorities. What is missing from the CBA is any discussion of TA, training 
requirements, learning objectives or any other ISD/SAT attributes, which are all essential. 
This situation is the result of the JCIDS policy guidance that states: 

Since the JCIDS process ultimately identifies which gaps are pervasive or 
important enough to address, the suggested gaps must be directly linked to 
operational situations and the consequences of failing to meet objectives. 

The ENA results in a prioritized list of gaps that are directly linked to 
priorities in strategic guidance. (Training and Doctrine Command, 2011) 

While alignment with strategic interests is essential during times of decreasing 

resources, the JCIDS process has been systematically eroded in areas where critical in- 

depth analysis is necessary (GAO, 2012). Artificial time constraints and personnel cuts in 

offices responsible for conducting the front-end analysis for training systems (i.e., 

training developers—those people responsible for training program ISD/SAT analysis) 

have created a situation where analysis is either not done, is done poorly by individuals 

who do not understand the process, or is left up to the contractor to conduct. 

TRADOC training developers (TD) do not lead the JCIDS process, and in 
fact are only one facet of that process, and a weak facet at that. TRADOC 
is woefully short TDs and the ones that still exist are usually farmed out to 
other positions not related to training development. TRADOC leadership 
is aware of this shortfall. (Marco Conners, personal communication, 

August 27, 2012) 

Despite several attempts to locate training developers with experience in 
conducting front-end analysis for system development, none could be located to 
contradict or confirm this statement. Attempts took the form of multiple emails and 
phone calls to the U.S. Army Maneuver Center of Excellence, the U.S. Army Aviation 
Center of Excellence and the TRADOC capability management office for virtual systems 
(TCM-V). 
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2. Training Objectives and Performance Requirements 

ITE development is headed in the right direction when developers seek to 
comprehend the mission requirements, training objectives (TOs), tasks, and task 
requirements that an ITE is to support. TOs should be explicitly provided to ITE 
developers where they can be used to develop criterion measures that ultimately support 
the empirical validation of the TTE and training approach (Department of Defense, 2001). 
Scholars believe that providing TOs to ITE developers is important because TOs include 
critical information about task performance that should be considered during the 
development of ITE specifications. Analysis should also include consideration about how 
an ITE will be constructed to facilitate the effective translation of inputs and outputs 
between the ITE and the real world (Milham, Carroll, Stanney, & Becker, 2003; Salas, 
Milham, & Bowers, 2003; (Rose, Wheaton, & Yates, 1985). The USA defines a TO as a 
statement that describes the desired outcome of a training activity, which consists of the 
tasks, conditions, and standards (Department of the Army, 2011). Eor this research, TOs 
are viewed as key elements for any analytical model used to predict the utility of an ITE 
before it has actually been designed and developed. 

Muckier and Einley (1994a) discuss how the development of TOs is a step that is 
frequently ignored or done poorly during ITE development. They believe most ITE end- 
users cannot articulate what their training needs are. Eurthermore, they are ill equipped to 
provide useful technical input. End-users do not understand the possibilities of a new 
technology and often tend to fall into one of two categories, either extremely positive 
(“this system is awesome!”) or inappropriately negative (“the last thing we need is 
another computer device to help us train!”). Muckier and Einley (1994a) go on to say that 
the TD’s lack of knowledge has led to a situation where the ITE developer is the one who 
produces the TOs for the system. Our position is that the TOs and performance objectives 
should be provided by the customer (i.e., system end-user and TD) and used by the ITE 
developer as a guide to steer ITE development. Eailure to do this exposes the government 
to unnecessary risk and likely poor results. The customer (i.e., system end-user and TD) 
has the responsibility to establish training requirements so that the entire TTE research 
and development community can respond in support. 
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Performance requirements, stated as standards for military training, should be 
driven by decisions about which type of measurement is desired (i.e., “outcome-based” or 
“performance-based”). Outcomes-based evaluation focuses on achieving the ends without 
concern or focus on the means (Foster, 2009). Performance-based methods focus on the 
means to achieve the end as well as the end itself. Performance-based proponents argue 
that understanding what causes behavior is a key to determining the causes of poor 
performance (Salas et ah, 2008). Military training is characterized as having both 
outcomes and performance-based requirements. 

Rose, et al. (1985) discuss how performance requirements are often derived from 
either detailed design descriptions of equipment or from job descriptions of system 
operators. They describe how TDs use job descriptions as a source of data for 
determining the best way to develop ITEs and training programs. Typically, jobs are 
described in the form of task or skill analyses (TASA). Unfortunately, TASA have little 
impact on the development of TTEs during the material acquisition process (MAP) for 
two reasons. Eirst is the bootstrapping nature of ITE development. During the MAP the 
operational system takes priority. Second is the timing of TASA arrival. TASA often 
arrive after decisions about ITE design have been made. 

3. Task Analysis 

A commonly reiterated theme within the training literature is that task analysis 
(TA) is the most important step in ITE or training program design (Hays & Singer, 1988; 
Darken, 2009; Montague, 1982; Muckier & Einley, 1994; Sticha et al., 2002; Simpson, 
1995; Bloom & Yanko, 1986). TA is included as an important topic in many human 
factors engineering and training course textbooks (Patrick, 1992; Sanders & McCormick, 
1993; Wickens, Eee, Eiu, & Becker, 2004). TA falls within the boundary of the EAA 
portion of the CBA and is left to the training or ITE proponent to develop. Yet, when 
reviewing many ITE development documents, it appears that TA is not given the 
attention necessary to assure that it has the intended impact on the process. If executed at 
all, TA that supports ITE development tends to be superficial and does not appear to 
influence design decisions in any meaningful way. 
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TA is done for many purposes, one of which is to support the development of a 
training program. Generally, insight is required from the execution of an action, process 
or decision to support training or ITE development. For a TA to begin there must be an 
understanding that the results will provide necessary information for the advancement of 
some desired goal. When done properly, TA can be described as a laboriously detailed 
endeavor (Annett, 2004), which is perhaps the reason that it is done incorrectly, if at all. 
A point rarely considered, is that despite the effort required to execute a TA, the TA itself 
has a long shelf life. Expectantly over time, TAs may require minor updates or 
adjustments to account for the evolution in technology that supports activity. Executing a 
TA is a small price to pay considering the benefits that the TA provides in supporting 
various decisions throughout an ITE’s lifecycle. 

Various forms of task analysis have been developed over the years (e.g.. Time 
Study [Frederick Taylor], Motion Study [Frank Gilbreth], Task Description Analysis 
[Robert Miller], Critical Incident Technique [John Flanagan], Hierarchical [J. Annett and 
K. Duncan], GOMS [S. Card, T Moran and A Newell], and CDM [Gary Kline]) 
(Schraagen, 2006; Crystal & Ellington, 2004; Hollnagel, 2006). Each TA approach was 
developed to support the collection of information for a specific problem. There is little 
disagreement about the importance of conducting TA, however, there is some 
disagreement amongst authors about what form of TA is appropriate for a given situation. 
Because the results of these TAs are relied upon to support training programs and 
assessment models, some suggest that the assessment models may be the best place to 
start for determining which form of TA should be used (Hays & Singer, 1988; Muckier & 
Finley, 1994a, 1994b). One assumption made in this research is that the function of TA is 
more important than the form of the TA. The technique employed to conduct the TA 
should support the goals of the TA. As long as this is true, the TA should be sufficient. 

TA reveals more than just information about performance. A good TA also 
supports an understanding of the characteristics of the ITE. Without executing the proper 
level of TA, stimulus levels and ITE factors necessary for effective training support 
remain hidden. TA supporting ITE design must be done to yield the rich information on 
the factors that control and affect task performance as well as on the performance itself 
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(Smode & Hall, 1975). The level to which TA must be executed depends, therefore, on 
the performance objectives and desired training outcomes (Annett, 2004; Cockayne & 
Darken, 2004). This research will conduct TA to the level that supports an understanding 
of what is needed from the ITE to support the deliberate practice of specific tasks. 

4. Human Ability Requirements 

a. Introduction 

Too often, the focus of solutions to training capability gaps are too narrowly 
fixated on technology instead of an understanding of the training objectives, performance 
requirements and tasks, which enable effective training. For years, it seems that most of 
the work done by training specialists and system developers has focused on developing 
solutions to ill-defined training problems. It seems that a common assumption is that the 
more complex and highly technical a training solution is, the better it is. Walking the 
showroom floor at the Association of the United States Army (AUSA) conference or the 
Interservice/Industry Training, Simulation and Education Conference (I/ITSEC) supports 
this assertion. It is the unusual case to find any system at either of these shows that can 
produce substantive documentation supporting claims of training effectiveness. We are 
asked to trust that training support is good because the technology employed looks good. 
Unfortunately, the research conducted in TOT and ITE assessment has not provided 
overwhelming empirical evidence to support the assumption and it is unclear whether the 
focus on technology has been worth the cost (Muckier & Finley, 1994a). 

Human ability research has been ongoing since the 1960’s and has been used as a 
tool for empirical work investigating training system design and fidelity (Hays & Singer, 
1988; Napoletano, 2013). Initially, the Defense Advanced Research Projects Agency 
(DARPA) sponsored research into human abilities to assist the military with job 
placement and training (Cockayne, 1998). The human abilities body of research has been 
developed as part of an umbrella taxonomic effort attempting to standardize the way 
human performance is described. 
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b. Impetus for Development 

As described by Fleishman and others, the various fields that make up the domain 
of human performance research suffer from a lack of established taxonomies by which 
they are able to discuss human task performance (Darken, 2009; Fleishman & 
Quaintance, 1984; Fleishman & Bartlett, 1969). The goal of the taxonomy project was to 
make progress towards a common task-descriptive language that would assist in 
integrating the human-performance research literature. Taxonomies become essential 
when experts from various fields who use similar terminology attempt to work together 
to solve complex and shared problems. Without a mutually understood means to discuss 
the characteristics of a problem, little can be accomplished. The objective of the ability 
requirements approach was to identify and define the fewest number of independent 
ability categories that would be useful and meaningful for describing performance in the 
widest variety of tasks (Fleishman & Quaintance, 1984). 

Human ability development is an iterative process intended to produce a list of 
verified abilities that are empirically derived from patterns of responses to different tasks. 
The assumption is that specific tasks require certain abilities and that tasks requiring the 
same types of abilities can be categorized similarly. This assumption allows researchers 
to discuss task performance in relative terms. The human ability project, through 
experimentation and collaboration with multiple subject matter experts, derived 52 
human abilities with the possibility of adding more. Examples of human abilities are oral 
comprehension, deductive reasoning, mathematical reasoning, dynamic strength, gross 
body coordination, peripheral vision, depth perception, and sound localization. Abilities 
are grouped into one of four categories (i.e., physical, sensory, psychomotor and 
cognitive). The United States Department of Labor uses human abilities as the basis for 
their 0*NET (http://www.onetonline.org) program that provides information about jobs 
based on the human abilities needed to execute them. 

c. Relationship to This Research 

Ability refers to a human’s capacity to do something. Skill refers to the 
proficiency of a specific person in doing something. Through years of research. 
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Fleishman and his colleagues analyzed various jobs and tasks to ascertain and develop a 
list of 52 human abilities that can be found throughout various human activities. During 
this process, they executed numerous TAs. Through their process of defining ability 
requirements, they were linking information dealing with task characteristics to human 
abilities (Fleishman & Mumford, 1991; Fleishman & Quaintance, 1984; Fleishman & 
Bartlett, 1969). The results of their efforts led to means of description, understanding and 
categorization of human activity (i.e., work) based on human abilities instead of through 
the use of TA. Abilities are viewed as enduring attributes of the human being (i.e., they 
are the same in the real or virtual world). They play an important role in the methodology 
that allows us to determine the utility of an ITE. A complete list of the human abilities is 
provided for the reader in Appendix A. 

B. FIDELITY, AFFORDANCE THEORY AND TRANSFER OF TRAINING 

I. Fidelity 

Design decisions concerning fidelity should be made with an understanding of the 
training requirements that support knowledge and skill acquisition comparable to the 
operational environment (Milham et ah, 2003; Smode & Hall, 1975). This view 
contradicts the common reality of ITE acquisition where the major focus is on device 
fidelity or on obtaining a device that contains the most fidelity and instructional features 
as the budget will allow (Rose et ah, 1985). The focus on fidelity excludes any 
consideration for other aspects of the training program such as the effective use of 
instructors or ensuring the proper instructional settings. Hays and Singer (1988) point out 
that there is mixed data on the positive effects of high technology media on transfer of 
training (TOT). Some suggest that analyzing additional data on the impacts of fidelity in 
device design before leaping to develop more unfocused technology makes sense 
(Darken, 2009; Muckier & Einley, 1994a; Rose et ah, 1985). One glaring reason for this 
recommendation is the dominating role fidelity has played in lET effectiveness 
discussions. This domination is due to fidelity being the most observable and expensive 
attribute of an ITE. 
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In work supported by the Army Research Institute (ARI), Montague (1982), noted 
that often design parameters for ITEs are not specific about what training requirements 
the ITE must support. This situation limits the effective measurement and evaluation of 
the ITE in a training setting. Montague (1982) also points out that program managers 
(PMs) who are responsible for ITE procurement programs know little about training 
design principles and therefore, do not consider them. PMs do not understand or consider 
learning theory or the effects of performance measurement, feedback, and practice on 
learning. Counterintuitively, ITE effectiveness may be due to violations of system 
physical and temporal isomorphism. This is a hard concept for many to accept especially 
if they believe that the most important goal in ITE design is to provide high physical and 
stimulus fidelity. Effective ITEs need to faithfully support the simulation of the tasks to 
be learned in ways that teach users how to think and assist them in building appropriate 
mental models (Montague, 1982). In other words, fidelity is more appropriately focused 
on the task versus the device. 

Eidelity requirements should be a derivative of front-end analysis. Eew standards 
or guidelines exist that define what constitutes effective or sufficient fidelity or that 
translate task analysis information into a form that facilitates fidelity decisions (Smode & 
Hall, 1975; Hays & Singer, 1988). Sometimes standards enforcing fidelity have been 
established based on the complexity of the job situation (e.g.. Nuclear Power Plant 
operation) (Eevinson & Donovan, 1984). Eidelity is often associated with only the 
physical aspects of a system—those things that can be perceived by the senses. The idea 
that fidelity is composed of both physical and functional aspects has been discussed in 
detail in the three volume report produced by ARI (Rose, Martin, & Yates, 1985; Rose et 
ah, 1985). Research has provided evidence that psychological fidelity is more important 
than physical fidelity (Baldwin & Eord, 1988). However, the tendency has been to relate 
system effectiveness with physical likeness based on the operational equipment it 
mimics. This tendency can be traced back to the identical elements theory postulated by 
Thorndike and Woodworth (Thorndike, 1932). Thorndike stated that the more identical 
elements two tasks shared, the more similar they were, which supported the prediction for 
more positive transfer of training (TOT) (Patrick, 1992). Empirical research has 
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demonstrated this situation to be true in some areas (e.g., the retention of both motor and 
verbal behaviors). However, other research reveals that having identical elements 
between tasks or systems is a necessary but insufficient condition for positive TOT to 
occur. This sentiment is also offered about the relationship between learning and training 
(Baldwin & Ford, 1988; Patrick, 1992). While Thorndike and Woodworth’s theory of 
identical elements has generally held as a basis for both TOT and device high fidelity 
recommendations (Muth & Switzer, 2009), Hays & Singer (1988) highlight the flaw in 
the logic behind using only physical fidelity as a determinant for TOT. They affirm that 
an ITE is made up of technology, people, processes and documentation, as well as the 
relationships between these elements. If the pieces are viewed individually, many 
qualities derived from the interactions of these various parts are lost. This is a significant 
reason for not solely basing judgment of ITE effectiveness on physical fidelity. 

ITE fidelity is an important consideration when evaluating TOT. The purpose of 
this research is to identify the utility of an ITE to support TOT using the hypothesis that 
an analytical assessment methodology based on human abilities and affordance theory 
can predict task elements within an integrated training environment with the highest 
likelihood of positive TOT . We are not conducting a TOT study or an analysis of the level 
of fidelity necessary for TOT. The focus on fidelity here supports the identification of 
ITE affordances necessary to stimulate the human abilities associated with the task 
elements specified for practice within the ITE. 

2. Affordance Theory 

This dissertation focuses on the classification of an ITE’s utility in supporting the 
trainee, specified training objectives and performance requirements by focusing on the 
affordances resident and absent within the ITE. Affordance theory comes from ecological 
psychology and James J. Gibson. Gibson (1986) coined the term “affordance” to capture 
the essence of what an environment offers or provides an animal in either a positive or 
negative fashion. Affordance theory provides a context for discussing the qualities of the 
human-environment relationship within an TTE. Precedent exists for the use of affordance 
theory in supporting computer science and human factors research (Baerentsen & 
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Trettvik, 2002; Chemero & Turvey, 2007; Lintern, 2000; Rome, Paletta, §ahin, Dorffner, 
Hertzberg, Breithaupt, Fritz et al., 2008). Affordance theory is naturally associated with 
human abilities, most notably with human perception. 

Gibson intended for affordances to represent something that refers to both the 
environment and the animal unlike any existing concept. Affordances are perceived by 
the animal, but they are independent of the act of perception; they are action-referential 
properties of the environment (Michaels, 2003). Gibson believed that affordances could 
not be directly measured. An example of what an affordance is can be found by 
examining a coffee mug. A coffee mug affords several things—a way to be held (handle), 
a way to contain or carry liquids and support for drinking. A more relevant example is an 
ITE that has been designed to train Highly Mobile Multi-purpose Wheeled Vehicle 
(HMMWV) drivers that contains vehicle mock-ups. Without knowing the extent of 
mock-up fidelity, we can assert that this ITE affords some level of HMMWV training. 
The extent of the ITEs utility for specific HMMWV training requires further analysis of 
tasks and performance objectives as previously mentioned. Since affordances are relative 
to the animal (in this case a human), a new soldier viewing a HMMWV mockup will 
perceive different affordances than a more seasoned NCO who has extensive experience 
with a HMMWV. 

Gibson (1986) believed that perceiving was not a process of assigning value to an 
object. Rather, it is the process of recognizing the inherent value, benefit or harm that an 
object or situation provides. Affordances exist as properties of both static and action 
states in the training environment (Stoffregen, 2003). This concept is important in regards 
to this research as the methodology developed herein is meant to provide insight into the 
utility of an ITE that contains both static and active states. In a break with other 
psychologists, Gibson believed that, while objects have qualities such as color, size, 
texture, and shape, those are not what humans perceive. Rather, he asserted that what we 
perceive is actually what the objects afford. This concept is intuitive in regards to 
physical objects. With respect to the affordances of behavior, however, Gibson stated, 
“behavior affords behavior” (Gibson, 1986, p. 135). He proposed that the affordances of 
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behavior depended upon the perception or misperception between animals making the 
identification of behavioral affordances less certain. 

Gibson’s theory of affordances has been met with varying degrees of enthusiasm 
and criticism over the years (Jones, 2003b). Controversy over opposing ideas prompted a 
special issue of the Journal of Ecological Psychology dedicated to a debate on the subject 
(Jones, 2003a). As initially described, the concept of affordances was simple, clear and 
appealing (Michaels, 2003). However, Gibson’s later attempts to describe affordances in 
more detail, resulted in a situation that “makes them seem like impossible, ghostly 
entities, entities that no respectable scientist (or science worshiping analytic philosopher) 
could have as part of their ontology” (Chemero, 2003, p. 182). Attempts at providing 
clarity and concrete definitions for affordances have been offered and debated 
(Stoffregen, 2003; Turvey, 1992). Unfortunately for the scientific community, Gibson 
died before he had the opportunity to solidify the concept of affordances for the field of 
ecological psychology and the world. While various perspectives continue to exist within 
the domain of ecological psychology over affordances, further elaboration of their 
discussion remains outside the scope of this research effort. Readers interested in further 
discussion of affordances and affordance theory are directed to (Gibson, 1986; Jones, 
2003a). 

Affordances and affordance theory are used in this research as a means of 
identifying the qualities and characteristics of the ITE that are absent or present in 
relation to the human abilities associated with specific tasks. We have elected to use 
affordances as part of our methodology because they provide context and afford us an 
opportunity to view an ITE unlike any other approach. Using affordances we are not only 
able to identify the characteristics of an ITE that support deliberate practice; but also why 
those identified characteristics are important to the trainee’s execution of the tasks. 
Through the use of affordances, we are able to determine specific task elements with the 
highest likelihood of positive TOT. 

3. Transfer of Training 

The following section provides a review of the transfer of training (TOT) 

literature. This review is based on four meta-analyses (Baldwin & Eord,1988; Eord & 
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Weissbein, 1997; Salas & Cannon-Bowers, 2001; Blume, Ford, Baldwin, & Huang, 
2009). These four meta-analyses provide a comprehensive review of the literature that 
spans a century. Unless indicated otherwise, all of the material in this section was 
obtained from these four references. 

Positive TOT is the ultimate goal and reason for every training program. While 
we acknowledge this goal, TOT is not the primary focus of this research effort. There are 
no attempts made to identify measures of performance or to evaluate training or specific 
training systems. Rather, our focus is on an ITE’s ability or potential to support deliberate 
practice. We recognize that this research effort is a small piece of a larger training 
program “puzzle” that is very concerned with TOT. Therefore a review of the current 
literature has been conducted and is presented here with an eye towards TOT’s impact on 
ITE utility. 

Training is expensive to execute. Various authors have provided cost estimates 
over the years of what industry spends on training and what percentage is believed to be 
effective. Estimates provided are $125 billion spent on training with 10 percent believed 
to be effective (Baldwin & Eord, 1988; Blume et ah, 2009). While training is expensive, 
conducting research into its effectiveness is an additional expense. A positive note within 
the literature is that the amount and quality of research into TOT has improved. 
Previously there existed a belief that only a limited number of fragmented empirical 
studies existed. Now there is an understanding that more training related research is 
available than in the past three decades (Baldwin & Eord, 1988; Salas & Cannon-Bowers, 
2001 ). 

Eigure 4 visually describes the TOT process. The dashed lines indicate linkages of 

inputs to outputs and conditions of transfer. Recent reviews have clarified where the 

impacts of technology, characteristics influencing the technology (e.g., fidelity), the 

effects of feedback, and practice are incorporated in the diagram. These factors are 

important because the early trend in TOT research focused solely on training outcomes 

whereas today the focus is more on evaluating the training process. When investigating 

the training process, the impacts of technology must be considered. Outcome-based 

assessment does not provide the necessary insight into where training and technology use 
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is sub-optimal. Conversely, process-based assessment has its challenges as well, one 
being attempting to identify where and how technology best supports the execution of 
complex military tasks. Challenges in properly applying technology in training add to the 
difficulty in successfully using process-based evaluation techniques (Milham et ah, 
2003). These points are important to consider because this research attempts to identify 
limitations in TTEs consisting of various devices (i.e., TADSS) that impact the deliberate 
practice of specific tasks. 
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Training transfer process model (from Baldwin & Ford, 1988, p. 27) 


Due to the ambiguous nature of military operational environments, various 
training design architectures (e.g., the general principles approach and stimulus 
variability) are very applicable to military training and TOT. These two approaches view 
specific skills training, heuristics, and variations in the stimulus presented during training 
as being valuable when designing training that facilitates transfer. All of these items 
when used in concert have an impact in training higher order cognitively intense tasks. 
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An important subject receiving well-deserved emphasis today is the trainee and 
those trainee characteristics that enhance TOT. Research into trainee characteristics 
ranges from topics of motivation to intelligence. Discussions about the trainee in relation 
to TOT provide a consistent theme—TOT is greater with trainees who demonstrate the 
characteristics of self-confidence, positive motivation and self-efficacy. Intuitively, 
intelligence is also a key variable in whether or not trainees will be successful but the 
impacts of intelligence have demonstrated task and situational dependence. We believe 
that the focus on the trainee is paramount. This research places the trainee in the center of 
the assessment methodology through the use of both human abilities and affordances. 

The TOT literature reveals an overt focus on training input factors, rather than one 
on investigating the appropriate measurement of transfer conditions. The lack of focus on 
transfer conditions continues to hinder our understanding of which design factors 
contribute to or detract from transfer. This is important to the current research effort 
because we focus our attention on the ITE itself. We examine the ITEs ability to support 
the deliberate practice of tasks based on the affordances available to facilitate task 
execution. The results from our examinations provide information that supports a better 
understanding of important design factors within an ITE. 

The meta-analysis done by Blume et al. (2009) points out a significant element 
missing from the literature, which is the impact of training objectives on transfer. While 
the literature notes that training objectives are intended as the outcomes from training, 
their use as a guide to direct the selection of evaluation criteria for TOT studies is eerily 
absent. This is reinforced in the task analytic, simulation assessment and fidelity 
literatures that all comment on the lack of emphasis placed on training and learning 
objectives. 

Emerging research includes the idea that error-based learning provides for better 
transfer to an operational setting. Instead of constructing ITEs that minimize the effects 
of errors, new error-filled ones are being employed. Those ITEs immerse and engage 
trainees more actively. These are the kinds of ITEs where trainees are allowed and 
possibly encouraged to make errors so that they may practice adaptive decision-making. 
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These types of ITEs further reinforce the general principles and stimulus variability 
approaches to training design, which were previously noted as being important to military 
leader development. 

The ultimate goal of TOT studies is to demonstrate improved human 
performance. A brief but applied review of the literature on TOT has been provided and 
its importance to the current research has been discussed. As the literature has pointed 
out, there are many variables in the TOT puzzle. This dissertation supports the resolution 
of the TOT problem by providing a way to examine ITEs to determine how well they 
support the deliberate practice of tasks necessary for improved performance. 

C. VERIFICATION AND VALIDATION 

Verification and validation (V&V) are included in this review in contrast to 
simulation assessment conducted as part of the USA training effectiveness analysis 
(TEA) system. V&V are processes that are performed using the most appropriate 
techniques best suited to the application under study. Verification is understood in many 
circles to mean the process by which something is evaluated to ensure it is consistent 
with its specifications. Validation generally refers to the evaluation process used to 
determine if something satisfies the requirements of its intended customer or user. 
Validation in the modeling and simulation context is concerned with representational 
accuracy (i.e., primarily on the model’s result) and is guided by the requirements 
specified by the customer (Petty, 2009). Eormal Department of Defense (DOD) 
definitions for V&V are found in Under Secretary of Defense (2009). It is a formal policy 
within the DOD that models, simulations, and associated data used to support DOD 
processes, products, and decisions, undergo V&V throughout their lifecycles (Under 
Secretary of Defense, 2009). 

A distinguishing feature between V&V and the analytical assessment 
methodology derived as a part of this dissertation is the timing in which they are applied. 
Within the V&V framework, artifacts that are meant for comparison undergo V&V when 
they become available. This implies that a tangible item is available for testing and 
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evaluation. Our methodology views intervention and assessment as appropriate as early 
on as the training-needs analysis phase and as late as the products delivery. 

Feinstein and Cannon (2002), and Sargent (2010) provide information about how 
empirical TOT studies and various forms of validation are conducted. Knowledge of 
these two activities provides insight into why training system assessment and V&V of 
training systems are often viewed synonymously. Both ITE assessment and V&V require 
valid data. Several analytical and empirical methods designed to assess TTEs require 
empirically validated data, which has prevented their adoption and use. The failure of 
these methods will be discussed later in the simulation assessment section. 

Reviewing the TOT, simulation assessment, and V&V literature leads us to the 
conclusion that there are similarities and overlap both mechanically and procedurally 
between ITE assessment and V&V. The main difference between the two exists in the 
understanding of the complexity involved with evaluating human performance as 
opposed to other less dynamic, mechanical and procedural systems. The analytically 
minded reader may believe that almost anything can be reduced to a series of logical or 
mathematical models that may be empirically examined. However, there is considerable 
variability, both within and between human trainees. This variability makes the 
examination of TTEs that support them much more difficult. Instead of waiting until 
artifacts are available, early intervention in shaping requirements and identifying critical 
factors, are better approaches to influencing the validity and utility of integrated training 
environments. 

D. IMPACTS OF SUBJECT MATTER EXPERTS 

Reliance on subject matter experts (SMEs) is a mainstay in the training domain. 
The value of expert opinion and expert reliability in various circumstances has been 
demonstrated repeatedly (Ericsson, Charness, Eeltovich, & Hoffman, 2006) but is not 
without its limitations (Hubbard, 2009; Marks, Smead, & Alt, 2013). This dissertation is 
not about expertise or expert performance but it is replete with discussion about the 
impacts that SMEs have on both the design and evaluation of TTEs. It is likely that there 
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will always be a role for SMEs in ETE assessment, but SME elicitation must be structured 
and used carefully with an understanding of its limitations. 

1. Positive Contributions 

An expert is “a person who has a comprehensive and authoritative knowledge of 
or skill in a particular area” (New Oxford American Dictionary, 2005). One of the most 
important points that can be made about SMEs is that they are considered specialists in a 
certain area and that their expertise does not necessarily transfer to activities outside of 
that specific area. In other words their expertise is domain specific (Ericsson, 2006). 
Expertise refers to the characteristics, knowledge and skills held by experts that separate 
them from other people within the same domain. When used appropriately and within 
their area of expertise, experts provide valuable support. An example of the appropriate 
use of a military SME is relying on the opinion of an Army or Marine Corps infantryman 
in regards to basic rifle marksmanship. Their opinions in this example are appropriate 
because these service members rely on the rifle as their primary weapon system. Their 
knowledge of the handling, disassembly/reassembly and operational employment of the 
rifle certifies them as experts with this particular piece of equipment. However, it would 
be less appropriate to rely on their opinions as to the appropriate level of visual fidelity 
necessary in a computerized marksmanship virtual trainer unless they have received a 
technical education in modeling and simulation. SME opinion and input are used 
frequently in design, assessment and validation activities. 

2. Negative Impacts 

Often SMEs are plagued (most unknowingly) by a sociological phenomenon that 
mistakenly assumes that the role of SME and the role of relative expert are synonymous 
(Mieg, 2006). More simply put, it is often assumed that working in a domain (e.g., 
training) qualifies one as an expert of that domain. Additionally, it is often implicitly 
assumed that the information obtained from SME elicitation is acceptable (Marks et ah, 
2013). When these assumptions are false, many of the negative issues previously 
mentioned occur. SME input is usually sought when time and money for ITE evaluation 
is limited or when other more empirical means (i.e., TOT studies) cannot be employed. 
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Research has demonstrated that many SMEs base their estimation of ITE effectiveness on 
physical device fidelity. It is troubling that these same experts are often untrained in ISD, 
yet reliance on their opinions is used as the basis for acceptance decisions in multi¬ 
million dollar programs. 

Marks et al. (2013) suggest that the problems with relying on SME data are 
caused by elicitation and modeling bias. Elicitation bias may be classified as either 
motivational or cognitive. Motivational bias occurs when experts do not report their true 
judgments of a situation whereas cognitive bias occurs when SME judgment does not 
accurately represent the qualities of interest in a given situation. Modeling bias occurs 
when an analyst uses flawed or incorrect methods (tool or training bias) to apply SME 
data to a problem or situation. Modeling bias contributes to the potentially negative 
impacts of SMEs. 

In their review of Sauer and Askren (1978), Muckier and Einley (1994b) reinforce 
the danger of relying on SME evaluation. They noted the average to poor results of using 
SMEs to estimate the effectiveness of a training program supporting maintenance training 
and pointed out the tendency of the experts to overestimate the amount of time required 
to be trained on a particular skill. Eurthermore, their feedback on the impact of equipment 
on the training program was inconclusive. The problem of overestimation is not unique to 
the training domain. Hubbard (2009) discusses the problem of “catastrophic” 
overconfidence in the area of risk management and argues that all humans are 
overconfident. He suggests calibration training as a mitigation strategy. 

3. Recommendation 

SME input is critical to various aspects of ITE design (e.g., task analysis, 
performance requirements). However, a stricter adherence to the spirit of expertise and 
structure of SME elicitation is necessary. Determining the level of one’s expertise prior to 
their use in validation activities (i.e., Hubbard’s calibration idea) ensures that experts are 
qualified to render judgment, and that their recommendations are at the appropriate level. 
Utilizing more than one SME (recognizing the limitations of individual SMEs) to provide 
input on TTE designs prevents a situation where one person’s experience is viewed as the 
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norm for an entire domain. Marks et al. (2013) recommends taking time to develop, 
screen and test the SME elicitation technique, ensuring that the technique fits the 
expert(s) rather than forcing the expert(s) to adapt to a specific analysis method. This 
helps to prevent external factors from directly or indirectly influencing SME judgment. 
Informing and educating SMEs on other factors impacting the analysis (e.g., trainee 
differences, ISD/SAT principles) assists in the appropriate application of their judgment 
and ensures their utility. Blindly accepting SME opinion based on the assumption that 
they have mastered everything within a domain is as foolhardy as ignoring their input all 
together. 

E. SIMULATION ASSESSMENT 

I. Non-Training Domains 

Simulation assessment in analytical areas have used methodologies to support the 
selection of software packages based on surface features (Banks, 1991; Hlupic & Mann, 
1995; Eaw & Haider, 1989). Examination of the simulations has specifically focused on 
how well the software packages support activities such as analytical decision-making, 
system acquisition, test and evaluation (Deaver, 1987; Eossett et ah, 1991; Gass & 
Thompson, 1980; Holder, 1990; Tewoldeberhan, Verbraeck, Valentin, & Bardonnet, 
2002). Notable emphasis is placed on hardware requirements and characteristics of the 
hardware such as extensibility, flexibility, graphical support and input and output data, 
just to name a few. This knowledge is then applied to support simulation acquisition 
decisions. 

Simulation assessment has not enjoyed as much attention as simulation selection 
in the non-training domain literature (Jadhav & Sonar, 2009; Nikoukaran & Paul, 1999). 
Given the significant number of features that may be used to describe simulation 
software, authors have taken the approach of developing and using hierarchies and 
multiple stage models to describe the essence of their simulation selection methodologies 
(Jadhav & Sonar, 2009; Tewoldeberhan et al., 2002). In their review of the literature, 
Jadhav and Sonar (2009) summarized many of the current simulation selection 
methodologies. They developed and offered a generic stage-based model that adequately 
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captures the essence of many of the approaches used to select simulation software. While 
the methodologies developed for selection are useful, some authors have recognized that 
the methodologies have a misplaced focus. They believe that too much emphasis has 
been placed on simulation features and not enough on developing a means to evaluate the 
actual simulation software (Nikoukaran & Paul, 1998, 1999). Despite their focus on 
features, a subtly stated or implied goal of the various methodologies is to determine the 
suitability of the software based on the needs of the customer (Hlupic & Paul, 1995; 
Jadhav & Sonar, 2009; Nikoukaran & Paul, 1998, 1999). 

One possible explanation for the focus on surface features and emphasis on 
selection might be found in the way that simulations are viewed and characterized in non¬ 
training domains. Here, simulation is a tool that is viewed as being in one of two classes: 
simulation languages or simulators (Azadeh, Shirkouhi, & Rezaie, 2010; Hlupic & Paul, 
1995, 1996; Law & Haider, 1989; Nikoukaran & Paul, 1999; Nikoukaran, Hlupic, & 
Paul, 1998, 1999). Banks (1991) includes spreadsheets and rapid modeling tools in his 
discussion of classes but mentions that these tools are for smaller tasks and that they are 
limited compared to languages and simulators. Simulation languages are viewed as being 
useful to develop models and programs. They require more expertise but are more 
flexible. Simulators are built to serve a specific or range of specific purposes. They do 
not solve every possible problem. As Nikoukaran and Paul (1999, p. 2) describe them, 
simulators are “like a toolbox containing a limited number of different tools and maybe 
some flexible ones.” With this in mind, we now have better insight as to why features of 
simulations are focused upon by analytical users rather than their impact on the 
organization or individuals using them. Surface features can be linked, traced or 
identified as necessary to address aspects of specific challenges. Within this domain, 
simulations are used to support problem analysis and modeling, problem solving, 
decision-making, and situational understanding, but not the training of personnel to 
execute work or tasks. 

Jadhav and Sonar (2009) highlight several pieces of literature that attempt to 
evaluate simulations within the manufacturing domain and other analytical areas. While 
evaluation was in the title of these works, none of them described any methodology to 
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evaluate the performance of the simulation. Rather, they evaluated simulation package 
features using various analytical means such as applying 

• Criteria and criteria weighting (Tewoldeberhan et al., 2002) 

• The analytical hierarchy process (Davis & Williams, 1994) 

• Fuzzy set theory combined with the analytical hierarchy process (Azadeh 
& Shirkouhi, 1995) 

• Fuzzy set theory combined with multi-criteria decision theory (Cochran & 
Chen, 2005). 

While most of these additional steps added valuable rigor in the decision-making 
process for selecting a package, none of them evaluated a simulation. All of the 
evaluation methodologies reviewed use the same basic structure borrowed from the 
selection literature of identifying and prioritizing the important features of the simulation 
software for the customer. None of the evaluation techniques discover or determine how 
well the simulations perform; rather, they support the activity of choosing a package. 
This makes them largely unsuitable for use in evaluating a simulation designed to 
enhance human performance or knowledge and skill acquisition. 

2. Within a Training Domain 

Several meta-analytic reviews investigating the state of the art in analytical ITE 
assessment have been conducted (Muckier & Finley, 1994a, 1994b; Simpson, 1995; 
Tufano & Evans, 1982; Wheaton et al., 1976). These reviews indicate that since about 
1960, various forms of training and cost effectiveness models and programs to assess 
ITEs have been developed and implemented. While many of the efforts had merit and 
some demonstrated their usefulness in various contexts, few if any of them are currently 
used despite their advantages. Reasons given for not using the models include their 
complexity, extensive empirical data requirements, and costs in time and money to run 
and maintain. Many of the analytical methods developed do not have adequate and 
complete public documentation or software algorithms, which makes their 
implementation almost impossible. Changing service priorities and lack of acceptance 
round out the list of reasons why ITE designers do not use training estimation models 
(Morrison & Hammon, 2000; Muckier & Einley, 1994a; Simpson, 1995). 
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From the reviews, Simpson (1995) concluded that the training domain needed to 
work to produce guidance on how to develop and describe method selection, methods and 
case studies in support of DOD’s cost effectiveness analysis of training (CEAT) efforts. 
In Simpson’s (1995) view, much was done to develop various methods to determine ITE 
effectiveness but guidance on how to conduct ITE analysis was missing. Simpson (1999a, 
1999b) provide guidance to help analysts design meaningful training effectiveness 
evaluations (TEE). The two volume document describes procedures for alternative 
methods of conducting TEE and provides examples of TEEs that may be used for 
emulation (Simpson, 1999a, 1999b). Despite Simpson’s (1999a, 1999b) efforts, there is 
no indication that the development of what Simpson called “CEAT methods” was 
accomplished. 

Models and simulations are used in the training domain to create ITEs. 
Assessment of those ITEs is linked to knowledge and skill acquisition and human 
performance. Gorman (1991) categorized simulations as being in one of three groupings: 
(a) constructive (b) subsistent or (c) virtual. Currently, the DOD describes simulations as 
live (Gorman’s subsistent), virtual and constructive. Games have been added in recent 
years to account for the increased use of commercial off-the-shelf (COTS) computer 
gaming technology in support of training. Current definitions for live, virtual and 
constructive simulation found in Under Secretary of Defense (1998) are 

• Eive—simulation involves real people operating real systems 

• Virtual—simulation involving real people operating simulated systems 
and 

• Constructive—models and simulations that use simulated people operating 
simulated systems. 

Under Secretary of Defense (1998, p. 133) elaborates on its definition of 
constructive simulation with “real people stimulate (make inputs) to such simulations, but 
are not involved in determining the outcomes.” The term hybrid simulation is also 
defined in Under Secretary of Defense (1998, p. 125) as “a simulation that combines 
constructive, live, and/or virtual simulations, typically in a distributed environment. Such 
simulations typically combine simulators with actual operational equipment, prototypes 
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of future systems, and realistic representations of operational environments.” While 
“hybrid” is typically used to describe what we refer to as ITEs, the definition is neither as 
specific nor as inclusive as ours. 

Morrison and Hammon (2000) discuss what they call large-scale training 
simulations (LSTS). They categorize LSTS by saying that LSTS provide a wide array of 
support to training and readiness assessment including the ability to rehearse missions, 
support both collective and individual training, and performance assessment. Morrison 
and Hammon (2000) point out that the size and complexity of LSTS distinguish them 
from other simulation based training systems. LSTS include robust content and support a 
large number of possible training objectives. Given their size, all attempts to determine 
their effectiveness must be expansive as well. We believe that our definition of TTEs 
includes LSTS appropriately. 

Considerable work has been attempted to assess the impact of various training- 
aids, devices, simulators and simulations (TADSS) that make up ITEs designed to 
improve human performance and skill acquisition. Prompting research are statements like 
those made by Smode and Hall (1975) lamenting on the meager amount of data 
supporting device evaluation and TOT. The lack of data supporting device evaluation, 
intuition, and uneven research results, has resulted in an overreliance on engineering 
facsimiles as the basis for ITE design decisions. 

Often, researchers have attempted to assess the value of training and TADSS 
through the use of empirical means such as TOT studies or formal technical system 
evaluations, believing that these provide the best evidence of effectiveness (Salas et ah, 
2008; Simpson, 1995). In their review of training from 1990 to 2000, Salas and Cannon- 
Bowers (2001) point out that more empirical training-related research exists now than 
ever before and that the money spent on training evaluation varies between $55 and $200 
million dollars annually. These empirical types of activities are difficult to conduct 
however, during periods of decreasing resources (e.g., Burnside, 1999; Dawdy & 
Hawley, 1982; Simpson, 1995; Sticha et ah, 2002). 
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For many reasons, effective evaluation of human performance and ITEs continue 
to elude us. Salas and Cannon-Bowers (2001, p. 487) provide insight: “training 
evaluation is one of those activities that is easier said than done. It is labor intensive, 
costly, political, and many times is the bearer of bad news.” Sticha, Campbell, and Knerr 
(2002) surmise that a large part of the problem is due to the lack of organization of the 
research. The disorganization has resulted in a failure to produce specific methods to 
assist in the selection of virtual environment (VE) solutions, guide their development, or 
assist in evaluating their effectiveness. Usually, researchers approach the determination 
of ITE effectiveness by assessing task performance and the behavioral processes and 
outcomes, which have previously been noted as difficult at best. In many cases, these 
items cannot be measured and so analysts rely on subjective estimates of ITE capabilities. 
These subjective estimates are often provided by SMEs who are untrained and ignorant 
of training program design theory and practice (Morrison & Hammon, 2000). 

Efforts to develop better and less expensive approaches to assess TTE 
performance have resulted in non-empirical methods to evaluate ITEs. (Burnside, 1990; 
Gilligan et ah, 1990; Keesling et ah, 1999; Nolan, 2007; Sticha et ah, 2002). Use of 
analytical methods for assessment is important because it is the only way to evaluate a 
system that does not yet exist (Morrison & Hammon, 2000; Simpson, 1995). While this 
statement seems intuitive, it is a key point worth expanding further. ITEs generally take 
years to design, manufacture and field. During that time, as a part of the system 
engineering process, iterative test, verification and validation of components goes on, but 
it is not until an TTE is fielded and formally tested that the customer truly learns the ITEs 
capabilities or usefulness. 

More recent research in training assessment conducted by Durrani, Geiger, Jones, 
Hale, and Street (2008) has proposed a statistical approach to evaluate ITEs based on 
knowledge and skill transfer. Durrani et al. (2008) focuses on physical and 
neuropsychological cue mismatches between the real and simulated environment as a 
way to evaluate ITEs without extensive empirical study. While interesting, their method 
is too difficult to implement by the training developer (TD). Darken (2009) has taken a 
different approach and proposed binding ITEs by identifying their strengths, weaknesses 
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and limits based on the human abilities they support with a goal of determining what 
specific tasks an ITE is best suited for. His proposal was influenced by the work of 
Cockayne (1998), who investigated the use of human abilities on one-hand and whole 
hand human performance in a virtual environment setting. 

A series of research studies sponsored by ARI provide the most relevant attempts 
to analytically determining the usefulness of ITEs (Burnside, 1990; Jacobs, Crooks, 
Crooks, Colburn, Eraser, Gorman, et ah, 1994). The studies employ an analytical 
methodology developed by Burnside (1990) referred to as the task performance support 
(TPS) code approach. The TPS code approach leverages the standards, tasks, and 
subtasks from mission training plans (MTPs) along with subjective ratings and decision 
rules to determine ITE effectiveness. The TPS code approach was applied to investigate 
the Simulation Networking (SIMNET) programs ability to satisfy training requirements 
as outlined by the MTPs for both mounted and dismounted armored elements. In 
Burnside's (1990, p. 23) own words “the method described in this report provides a 
comprehensive approach to assessing the capabilities of existing training devices and 
simulations” [emphasis added]. Burnside (1990) does not attempt to address the 
development of new systems. Sticha et al. (2002) extended Burnside’s (1990) TPS code 
approach through the development of the Specified Training Requirements in Virtual 
Environments (STRIVE) approach. STRIVE was used to evaluate the follow-on program 
of record to SIMNET called the Close Combat Tactical Trainer (CCTT). The goals of 
STRIVE were to “develop a method for evaluating the capabilities of virtual simulation 
to represent the tasks and missions within a given military application domain, to 
demonstrate the methods in two domains, and to propose ways to integrate the method 
with existing doctrine” (Sticha et al., 2002). 

Muckier and Einley (1994) reviewed 36 system estimation models. They noted 
that the definition of ‘system’ was narrowly focused and that most models they reviewed 
were only concerned with a training device or other media while leaving out other critical 
factors of the training program. During their discussion. Muckier and Einley (1994) 
emphasized the point that within this research area, “state of the art” has largely been a 
learning experience. The seeds of future innovations have been planted, the models 
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developed and lessons learned were necessary in order to prepare the field to understand 
the problems and possible future directions. They offered that “state of the art” has 
deficiencies that provide research opportunities, but also strengths that should be 
exploited. 

Two strong conclusions can be drawn from the literature that support the current 
effort— increasing the use of empirical methods to evaluate ITE effectiveness is 
infeasible, and sound analytical methods must be developed and employed, even though it 
is recognized that these analytical methods are not as scientifically rigorous as their 
empirical counterparts [emphasis added] (Hays & Singer, 1988). Within the training 
domain it is apparent that efficient and cost effective methods to evaluate ITEs are 
necessary. There is evidence to support the assertion that it is possible to quantitatively 
predict and evaluate alternative options to support training before ITEs are developed. 
The task that remains is to convince the training development community that some of 
the analytical assessment models do work and that they can be useful in supporting ITE 
development and assessment (Muckier & Einley, 1994). Some believe that sound 
analytical methods supporting development and assessment would be employed if placed 
into the hands of the appropriate users. To be effective, the methods must be designed so 
that they are easy to use and flexible enough to support both the training and engineering 
sides of system development (Rose et ah, 1985). 

F. TRAINING EFFECTIVENESS ANALYSIS (TEA) SYSTEM 

1. Overview of the TEA System 

The purpose of this section is to introduce the reader to what formerly was known 
as the USA Training Effectiveness Analysis (TEA) system. This overview is included to 
inform the reader of the Army’s expectations concerning the analysis conducted in 
support of developing and existing ITEs and training programs. Previously, studies were 
executed in an attempt to ensure that effective training products were fielded to the 
soldier and that alignment with the material acquisition process (MAP) was maintained. 
With the rescinding of TRADOC Regulation 350-32, the Training Effectiveness Analysis 
(TEA) System, program managers (PMs), training developers (TDs) and material 
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developers (MDs) now bear the responsibility for ensuring that proper evaluation and 
analysis of ITEs and training programs are conducted. 

The USA TEA system was formally established in 1975 as a Training and 
Doctrine Command (TRADOC) program focused on the impacts associated with training 
and hardware costs, hardware development cycles and complexity, training resources, 
and the overall effectiveness of Army programs to prepare soldiers for battlefield 
conditions (Neal, 1982). Prior to 2012, the TRADOC Analysis Center at White Sands 
Missile Range (TRAC-WSMR) was the Army’s lead agency for providing technical 
assistance and conducting TEA for training systems. TRADOC Regulation 350-32 
governed the TEA program. All TEA studies that were conducted were captured in 
formal reports that were provided to the initiator of the study and ultimately ended up in 
the Defense Technical Information Center (DTIC) library. 

2. TRADOC Regulation 350-32 

According to TRADOC Regulation 350-32, the Training Effectiveness Analysis 
(TEA) System (rescinded), TEA studies were the primary means by which TRADOC 
established and maintained quality control over products of training development and 
training delivery systems Training and Doctrine Command, 1994). Initially, the TEA 
system focused on a medley of cost, operational effectiveness and human factors 
assessment methods. The TEA system had many objectives but the ones of most concern 
to this research are to: 

(a) Evaluate and improve training development and training delivery systems 
by determining the effectiveness of training programs and products fielded 
or implemented 

(b) Determine the effectiveness of training innovations (i.e., new training 
technologies) that hold promise for resolving difficult training problems or 
improving existing training programs and 

(c) Assist in meeting training requirements through assessing training 
impacts, comparing alternative training strategies, and evaluating 
effectiveness of training solutions. (Training and Doctrine Command, 
1994) 

The TEA system focused mainly on cost and effectiveness and was one of many 
categories of studies used to inform resourcing decisions. TRADOC regulation 350-32 
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(rescinded) stated that no two TEA studies were the same and that ultimately it was the 
organizational entity and proponent for the study who would determine the quantitative 
or qualitative nature and focus of the assessment (Training and Doctrine Command, 
1994). In order to be effective, the TEA system exhibited the characteristics of 
centralized management, evaluative responsiveness over the life cycle of a program, 
deployment of interdisciplinary methods of evaluation, an independent evaluation 
philosophy and a focus on empirical data. 

Prior to being formalized, training and cost effectiveness studies went by various 
names (Training and Doctrine Command, 1994). The TEA system consolidated these 
various studies under one umbrella called “TEA” to facilitate efficiency within the 
program. TRADOC Regulation 350-32 (rescinded) organized TEA studies into one of 
three categories. (1) Those related to system acquisition designed to evaluate the 
effectiveness of new systems and coincide with system acquisition decisions; (2) Those 
used to evaluate current systems, which investigate the effectiveness of current training 
programs and investigate possible alternative approaches and technology solutions; and 
(3) Those executed with the intent of improving training study methods. This last 
grouping of TEA studies was executed with the goal of strengthening the overall TEA 
program (Training and Doctrine Command, 1994). 

Execution of TEA was directed to coincide with the various phases of the material 
acquisition process (MAP). TEA studies were numbered so that they could be associated 
with the corresponding phase of the MAP. Eor example, TEA-1 was executed during 
MAP phase 0 with a focus on supporting operational requirements document (ORD) 
development. Critical tasks to be trained, the methods available to train these tasks, and 
the critical training issues that needed attention during the acquisition process were 
identified during TEA-1 (Training and Doctrine Command, 1994). TEA-2 were 
executed during MAP-1 and generally built on the recommendations of TEA-1 studies. 
According to TRADOC, “Early TEA establish and define the training device 
requirements and costs, while later TEA refine and update this information. They provide 
supporting documentation for the TADSS ORD and ORD updates” (Training and 
Doctrine Command, 1994, p. 7). Post fielding TEAs (PETEA) generally, were conducted 
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12-24 months after system fielding or program implementation, to ensure that the 
ITE/program had settled into a steady state before evaluation began. 

TEA methodologies were never standardized and were often determined by the 
current state of ITE development and the study organizer. Although TRADOC Regulation 
350-32 (rescinded) set guidelines for the conduct of TEAs, it acknowledged that a single 
best method did not exist for measuring ITE effectiveness. Evaluator focus and questions 
were meant to determine which approach should be taken to evaluate an ITE. According 
to TRADOC, “Issues addressed by TEA for resolution of training problems are study 
specific. They are related to questions of training impact, cost effectiveness, training 
effectiveness, and training transfer” (Training and Doctrine Command, 1994, p. 10). In 
addition to quantitative methods, TEA studies included other diverse methods, such as 
qualitative analyses, field observation, task analyses, survey research, and questionnaire 
design and analysis. 

TEA studies provided insights, feedback and analysis to TDs and MDs on 
prototype systems, processes and designs that informed training program and ITE 
development and trade-off decisions at all levels of the IS D/S AT process. Additionally, 
these studies provided an audit trail during TTE development that impacted evaluation, 
analysis and design of training program and ITE alternatives. 

3. User View of the TEA System 

Years after the TEA system was initiated, several authors provided reviews and 
examples of the TEA system in action (Neal & Paris, 1985; Maitland 1982; Carter 1982). 
Interestingly, these discussions all happen to coincide between the years of 1982 and 
1985. Speculation over why there are not more reviews and discussion of the TEA 
system are not entertained here. Erom the available reviews, it is observed that authors 
have sometimes categorized the TEA process as a systems approach for assessing ITE 
effectiveness (Neal & Paris, 1985). Simpson (1995) concluded in prior research on cost 
effectiveness analysis that the Army had the most “comprehensive guidance” related to 
executing TEA studies. He and others have emphasized that the regulations and guidance 
are explicit on when to conduct analysis but they are much less clear about how to 
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conduct them (Carter, 1982; Maitland, 1982; Simpson, 1995). In his paper, Maitland 
(1982) provides information and an example of how one TEA was conducted in support 
of the USA’s Ml (Abrams) Main Battle Tank Operational Test. Carter (1982) provides 
an example of an attempt to provide standardization to the TEA study process. Carter 
(1982) also highlights that people typically tasked to conduct TEAs are not educational 
technologists and the lack of detailed guidance on how to conduct TEA is a threat to the 
accuracy of the evaluations. A TRADOC TEA handbook was drafted in 1980 yet it was 
never formally published as such (Matlick, Berger, & Rosen, 1980). Simpson (1995, p. 
56) noted that “the impression given is that the material was intended for use as a 
cookbook for performing TEA by an audience that lacks sophistication in the area.” He 
further believed that trying to replace the experience and skills obtained through higher 
level graduate education in analysis, experimental design and experimentation with a 
handbook, would be regarded skeptically by experts outside of the DOD. 

Neal (1982) and Neal and Paris (1985) in their discussions of TEA studies, 
suggested that comprehensive TEAs have to focus on five factors: (1) the soldier (2) the 
trainer (3) the training subsystem (4) the hardware subsystem and (5) the training 
environment. They discuss that TEA studies often provide the first opportunity to gain 
insight into characteristics that will be important in both personnel selection and in the 
development of trainer and leader characteristics necessary for developing soldier 
knowledge and influencing skill acquisition. They continued by saying that investigating 
and understanding the design, development and conduct of a training program, the 
devices employed and any other contributing products, provides insight into the most 
significant contributors to skill and knowledge acquisition that are clearly key in TOT. 

Neal and Paris (1985) further elaborated on the need to analytically assess novel 
ITEs and training program approaches early in their development, when empirical 
comparisons are not practical. This need resulted in the development of judgmental 
techniques using SMEs to assess ITE and training program alternatives. The use of 
analytical techniques that influence and lead to effective ITE design and implementation 
of training programs are critical during periods of decreased resources. When employed, 
these techniques prevent design flaws that complicate the training process or possibly 
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reduce design-induced training effectiveness problems. In wrapping up their remarks on 
the five factors, Neal and Paris (1985) discuss the organizational environment and the 
many other factors (i.e., policies, regulations, customs, priorities, perceived importance, 
training resources, personnel availability and turbulence, resource allocations, geography, 
weather, climate, etc.) that can impact training effectiveness. They suggest that by 
applying the proper focus during a PFTEA, the organizational factors affecting training 
effectiveness can be identified and assessed (Neal & Paris, 1985). Viewed from outside 
of the USA, this five-factor approach appears to closely resemble several of the training 
input factors considered when investigating TOT. 

Dawdy and Hawley (1982) describe and discuss what they believe are the nine 
major phases of a TEA, the first six of which they describe as preliminary yet essential to 
the training effectiveness and cost evaluation that follows them. The phases are 

• Identification of missions, functions, and tasks 

• Selection of tasks for training 

• Task analysis 

• Generation of course structure 

• Development of training program alternatives 

• Development of extended program of instruction 

• Analysis of training effectiveness and trainability 

• Determination of training program costs 

• Cost and training effectiveness trade-off analyses. 

The first three phases are focused on in this research and provide a means to refine our 
analysis and identify ITE gaps. Dawdy and Hawley (1982) highlight that often the 
experimental determination of program effectiveness is not possible, which leads to the 
use of analytical measures of assessment and SMEs. 

Practitioners of TEA recognize that the world is not perfect and that many 
influences have negative impacts on an organizations ability to properly conduct analysis. 
Simpson (1995) points out that the most significant impacts are time and money. He 
asserts that time affects TEA significantly and believes that there is an incentive to 
conduct TEA studies early in the program lifecycle. That incentive includes the 
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opportunity to save money and to identify needed program and ITE changes early on. 
However, Milham et al. (2008) point out that PFTEAs are most notable type of TEA 
conducted. They acknowledge that these post fielding studies are valuable but support 
Simpson (1995) by indicating that the late evaluation decreases the impacts that the 
results of the evaluation can have on changing a system. Figure 5 provides the reader 
with an appreciation of the effects of time, cost and the availability of training data during 
ITE development. Simpson (1995) adds that unit availability, participant training level 
and willingness to cooperate, and analyst experience also are significant factors that 
impact or limit the type and kind of TEA that may be feasibly executed. 



Prugram Phase 


Figure 5. Relationships among expenditures, data, and potential for change of an 

ITE during the acquisition lifecycle (from Simpson, 1995, p. 24) 

4. Conclusion 

The USA established a mechanism to provide analysis of training programs with 
the instantiation of the TEA system in 1975. Simpson (1995) offered that at that time, the 
Army system was the most robustly defined training analysis system that existed. System 
analysts (e.g.. Carter, 1982; Maitland, 1982) described the use of TEA studies for the 
benefit of their respective programs and went a step further to offer examples of how to 


45 



conduct TEA studies. Others (e.g., Dawdy & Hawley, 1982) have provided additional 
insight in how to conduct ITE analysis and what aspects of analysis were most important. 
Yet, in the summer of 2012, the USA offieially coneluded its last TEA study, eliminating 
both the office responsible for the conduet and oversight of TEA, and the regulation that 
governed the TEA system. Simpson (1995) described a TEA program as having three 
elements (i.e., the serviee promulgates in writing the requirement to perform TEA; an 
organization exists that is formally tasked with performing TEA; and the service 
publishes TEA reports). While we acknowledge that training effectiveness studies are 
still being conducted, we are able to assert based on Simpson (1995) alone, that the USA 
no longer has a TEA program. 

G. SUMMARY 

State of the art is normally understood to mean the condition of a field of research 
or technology at the present time. In the field of ITE effectiveness evaluation. Muckier 
and Einley (1994) stated that their summary of the literature revealed: 

Two deeades of exploratory development have resulted in a colleetion of 
mostly unconneeted and uncoordinated quantitative models. In one sense, 
the accumulated ‘state of the art’ has provided a large learning experience 
from which many major future advances may be possible. A point of view 
is that the past two deeades were neeessary to structure and to begin to 
understand the problem. (Muckier & Einley, 1994a, p. 26) 

If this was the ease in 1994, then what ean we say about today? Much has been 
learned but we have not yet fully addressed all of the problems that have been identified. 
The preeeding literature review provides the reader with two important prerequisites to 
this researeh: (1) background in the areas that are pertinent to the current research effort 
and (2) insight into the relationships between the important aspects of task analysis, 
human abilities and affordance theory that will be used for developing an analytical 
assessment methodology for ITEs. This review covered many topics that play central or 
supporting roles in the development of ITEs. We wish for the reader to have an 
appreeiation of the complexity of the assessment problem (e.g., fidelity, front-end 
analysis, levels of TOT, SME input etc.) and the implieations of failing to understand the 
importance of the topics provided in the literature review. 
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In summary, literature dealing with various aspects of the training domain has 
been presented. The impacts of not conducting proper front-end analysis were reviewed 
and the pitfalls of misusing fidelity as an assessment technique were discussed. The 
positive and negative impacts that SME input imposes on system design and evaluation 
were revealed. The literature reveals that SMEs tend to over rely on physical fidelity, 
usually without any real understanding of the other important pieces of ISD/SAT. An 
introduction to human ability research was presented and its linkage with TA in the 
current research was provided. Affordance theory was introduced and its linkage with 
ITE fidelity and human abilities was offered. Examples were provided to help the reader 
gain an understanding of affordances and their ability to indicate possible gaps in task 
performance within an ITE. A review of the TOT literature was provided, reinforcing 
many of the points previously made dealing with front-end analysis and assessment. A 
brief introduction and coverage of V&V was conducted that provided knowledge about 
the similarities between V&V and TEA. The literature reviewing forms of analytical 
simulation assessment both in and outside of the training domain was discussed. This 
review provided knowledge of the efforts executed to date in the field of simulation 
assessment and demonstrated the uniqueness of the proposed approach in addressing 
utility estimation of ITEs. To close the chapter, we introduced the reader to the USA’s 
Training Effectiveness Assessment (TEA) system, which, prior to closing in 2012 
provided the organization (policy, guidance, and manpower) to conduct ITE and training 
program assessment. 

The need for guidance on how to assess ITEs is real. The need to employ a 
methodical process that carefully considers many of the factors discussed in this section 
is clear. The problems with existing analytical models designed to measure training 
effectiveness have been noted. Our goal is to develop a flexible yet defined methodology 
that addresses the important aspects of ITEs by focusing on task analysis, human 
abilities, and affordances. We believe that by using these three components in symphony, 
information about the proper amount of fidelity and TOT will be illuminated for the ITE 
stakeholder. We hope that we are able to move towards what Muckier and Einley (1994) 
called simpler models that ask and answer simpler questions. 
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III. INTEGRATED TRAINING ENVIRONMENT ASSESSMENT 

METHODOLOGY 

The integrated training environment assessment methodology (ITEAM) is a 
human-centered systems engineering approach to the analysis of integrated training 
environments (ITEs). ITEAM was developed based on the lessons learned from the 
literature and on the recognition that front-end analysis is critically important to training 
system development. Of the pieces of a training program (i.e., technology, requirements, 
humans) it has been established that computer technology evolves the quickest (i.e., 
Moore’s law). Requirements determination takes place at a much slower pace. Human 
beings evolve the slowest yet their evolutionary stability is ignored in training program 
development in favor of an emphasis on technology. ITEAM takes this into account by 
recognizing that human trainee not the technology should be the bedrock of ITE 
development. 

ITEAM demonstrates value as a process that encompasses ITE requirements 
definition, verification, and assessment. As a requirements definition process, ITEAM 
focuses the discussion of ITE development squarely on performance shortfalls in terms of 
tasks and the human abilities necessary to execute those tasks. When used for 
requirements definition, ITEAM provides support to those attempting to visualize an TTE 
and how the TTE might support training. Articulation of the vision, in terms of tasks, 
abilities and affordances provides a base of necessary information used for ITE 
verification. Execution of the methodology to its end, allows users to conduct a sanity 
check on the level of support the TTE ultimately provides through the comparison of 
affordance requirements and available affordance resources. The use of a quantitative and 
qualitative scoring technique provides the evaluator and user with a way to gain insight 
into how well the ITE supports the deliberate practice of skills for specific tasks. 

Useful evaluation of an ITE is dependent on a clear articulation of the need for the 
ITE, an understanding of what the ITE will provide/support, and a clear statement of the 
desired measurable performance outcomes. Training program context is important. 
Understanding where and when an ITE will be used in the context of the training 
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program assists in determining the functional allocation between the user and the ITE. 
Figure 6 depicts the ITEAM model. The reader should approach the methodology 
beginning with the process described as “determine need” and move from left to right to 
“determine real world affordances.” From there the reader should step to “determine ITE 
human abilities” and move from left to right to “determine ITE affordances.” Finally, the 
reader should step down to “assess ITE level of support.” 
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Figure 6. Integrated training environment assessment model 


The next section breaks down the model and describes the processes and sub¬ 
processes of ITEAM. Several sub-processes of ITEAM are used more than once within 
the model. To avoid confusion, each sub-process is only described once. Each of the sub¬ 
processes is driven by questions that, when answered, provide the necessary details for 
the methodology. Appendix B provides the reader with examples of the questions asked 
during each of the sub-processes. 
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A. DESCRIPTION OF THE ITEAM PROCESSES 
I. Requirements Definition 

The processes involved in defining and determining the requirements for an ITE 
are depicted in Figure 7 and proceed from left to right. For existing ITEs, this process is 
used to determine what the ITE should contain to support the deliberate practice of 
specific tasks. For ITEs in development, this process may be used to systematically 
determine what should be included in the ITE specification to facilitate transfer of 
training. 
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Figure 7. ITEAM requirements definition process and sub-processes 


a. Describe the Operational Need, Capability or Performance Shortfall in 
Terms That are Specific and Measurable 

This sub-process requires several iterations and should result in an unambiguous 
statement that defines and pinpoints the problem that needs to be addressed. The sub- 
process provides insight into the development of an operational concept for the ITE and 
ideas of how performance improvement will be quantified. 

b. Determine and Describe the ITE Capabilities Using an Operational 
Concept and Functional Allocation 

This is the first step in determining how the ITE will support the need and 
provides insight into what human abilities will be involved in the TTE. This sub-process 
helps illuminate where the ITE may best be utilized in the training program. At the 
conclusion of this sub-process, a clear delineation should exist of what things the trainees 
will do and what support the ITE will provide to the training program and trainee. 
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c. Conduct a Job/Task Analysis of the Real World Activity to Identify the 
Critical Tasks Needed to Accomplish the Desired Learning/Training 
Objectives 

This sub-process should not terminate until the level of detail is appropriate and 
addresses the performance shortfall. The sub-process supports the development of or 
refinement in the learning objectives associated with the training and the POL The goal 
of this sub-process is to describe the tasks to a level of detail that supports identification 
of the human abilities associated with the tasks. 

d. Annotate the Job/Task Analysis with Human Ability Requirements 
Associated with the Tasks 

After the critical tasks and subtasks for job/mission success have been identified 
they should be annotated with the appropriate human ability requirements associated with 
them. All applicable abilities from each of the four categories (cognitive, sensory, 
psychomotor, physical) should be listed by task/subtask to ensure a complete human 
description of the evaluated activity. 

e. Determine and Describe the Necessary ITE Affordance Requirements 
Based on the Identified Human Abilities 

This sub-process should initially be approached broadly. An appropriate level of 
detail is reached when the affordance descriptions are rich enough to support a full 
understanding of the types and kinds of things necessary for real world execution of the 
tasks. Affordance descriptions should avoid specifying distinct solutions. The 
information yielded from this sub-process supports the design, development and 
assessment of the ITE hardware and software. 

2. Verification 

The verification process is used to compare the requirements for supporting task 
execution with the resources available within the ITE. Eigure 8 depicts the sub-processes 
involved in ITEAM verification. The verification process begins with determining the 
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real world requirements for both the human abilities and affordances. It then examines 
the ITE to determine the human abilities supported by the ITE and the affordance 
resources available within the ITE. 
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Eigure 8. ITEAM verification process and sub-processes 


a. Determine What Human Abilities the ITE Supports Compared to Those 
Necessary to Execute the Real World Tasks 

In this sub-process, an examination of the ITE is conducted to determine what 
human abilities the TTE directly and indirectly supports. The examination identifies the 
qualities of the ITE that enhance or detract from task performance. Initially this is where 
a determination is made as to whether or not the ITE supports the deliberate practice of 
the tasks and in what form the support takes (i.e., cognitive, sensory, psychomotor or 
physical). 

b. Determine the Affordances Present in the ITE 

This sub-process examines the ITE in an attempt to determine if the TTE contains 
the affordances that were previously identified as being necessary for real world 
execution of the tasks. An inventory of all of the characteristics of the ITE occurs and is 
initially guided by the real world affordance requirements list. The affordance inventory 
should not be constrained by the real world list; rather it should address all of the 
affordances available within the TTE. 
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3. 


Assessment 


Figure 9 depicts the assessment process and sub-processes involved ITEAM. The 
final process of assessment leverages the affordance requirements developed during the 
requirements definition process and the affordance resource inventory from the 
verification process. Those two pieces of information are compared and scored to 
determine the ITE’s level of support for the deliberate practice of specific tasks. This 
process is used to assess the ITEs potential support to training. 


Determine 
Real World 
Affordances 


Determine 

ITE 

Affordances 


Assess ITE 
Level of 
Support 


Eigure 9. ITEAM assessment process and sub-processes 


a. Quantify the Level of Support the ITE Provides to the Training 
Audience 

This sub-process allows SMEs and others who are knowledgeable about task 
execution and the requirements of the operational environment to determine the quality of 
support provided by the ITE. This determination is based on the presence of necessary 
affordances. The process begins with a comparison of the affordance requirements and 
affordance resources. The process ends with a qualitative statement of the expected level 
of ITE support to the deliberate practice of the specific tasks. 
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The next section provides details on how affordances are scored and how the 
overall rating of ITE support for the deliberate practice of tasks is developed. 

B. SUBTASK AFFORDANCE SCORING 

The scoring of ITE support to the deliberate practice of tasks is conducted in the 
following manner. ITEAM uses a five point ordinal scale with non-dichotomous values 
in conjunction with a ratio scale to determine the level of affordance presence within an 
ITE. The same scale is also used to rate the level of support the ITE provides to deliberate 
practice of tasks. Eigure 10, depicts the ITEAM scale. In its current form, ITEAM scoring 
treats all affordances equally. Incorporation of a method to weight affordances based on 
stakeholder requirements is recommended as an area for future work. 


Scale Definition 

5-Excellent - the ITE contains all but a few (90-100%) of the affordances determined 
during the analysis 

4-Very Good - the ITE contains a significant portion (70-89%) of the affordances 
determined during the analysis 

3-Good - the ITE contains a good portion (50-69%) of the affordances determined 
during the analysis 

2-Fair - the ITE contains some (25-49%) of the affordances determined during the 
analysis 

1-Poor - the ITE contains very few (0-24%) of the affordances determined during the 
analysis 


Eigure 10. Definition of the measurement system used in ITEAM 


The rating scale was purposely skewed to ensure that ratings of excellent would 
not be common. We set up the scale so that the first two scoring levels (Poor and Eair) 
each contain 25 percent. The next two scoring levels (Good and Very Good) each contain 
an additional 20 percent and the final scoring level (Excellent) contains only 10 percent. 
Constructing the scale in this manner provided a progressive level of difficulty in 
reaching a rating of excellent, which requires that an ITE contain 90 percent or better of 
the affordances identified as being required to support the deliberate practice of specific 
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tasks. Furthermore, the rating categories are used mainly for coarse comparisons. When 
we claim that ITEAM was able to predict an outcome from a TOT study, we use the 
number score, not just the category. 

1. Subtask Affordances are Unique 

A unique affordance is one that has not been previously evaluated or accounted 
for as part of another subtask evaluation. Figure 11 depicts one example of an analysis 
conducted that contained only unique affordances. 


Real >\'orld <R\V) Preconditions: Trainee h.)s been issued a mission order and 
understands his AO and Al; Trainee is familiar with troop leading procedures, 
mission analysis and M1£TT-TC'; Trainee has conducted steps 1 and 2 of the 
troop leading proeedurcs 

Enviroanunt Evaluation 

R\\ Task! 

R\V Human Abilities 


Environment ll.A 

Environmental 

Affordances 

Level of Support to 
training 

Conduct a terrain 
analysis irom a map 
and materials 
p^o^ ided by the 

Itigher headquarters 
using the acronvm 
OAKCX'(Obstacles. 
Avenues of 

Approach. Ke>' 

Terrain. Observation 
and Fields of Fire. 
C'over and 
Concealment K 

COCMTIVt: 

Wntlen Comprehension; 
Deductive Reasoning: 
Inductive Reasoning: 
Problem Sensitivity: 
Visualization: Spatial 
Orientation; Memorization 

SENSORY: 

Near Vision: Visual Color 
Diserimmation; 

PSVCHOMOTOR! 
Arm-Hand Steadiness; 
Manual Dexterity: Finger 
Dexlenly: 

Pin SICAL: None 

- Paragraph 1 of 

OPORl) that provides 
information trom 
higher headquarters 
about the terrain and 

weather. 

- Representation of the 
terrain that the trainee 
will maneuver over 
(c.g. map. aerial 
photographs) 

- [ntelligcnec 
information about 
enemy emplaced, 
natural or man-made 
obstacles known by 
the higher 
headquarters 

- Maneuv er Combined 
Obstacle Ov erlay from 
hieher headquarters 

COCIMTIVE: 

SENSORY: 

Near Vision; Visual 

Color Discrimination; 

PS\CHOMOTOR: 

Manual Dextenty: 

Finger Dexterity; 

PHYSICAL: 

None 

- Scenario editor allows 
for as much or as 
little detail as desired 
in paragraph 1 of the 
OPORD. 

- Scenario editor allows 
for as much or as 
little detail as desired 
w ith respect to 
intelligence 
information 

- Scenario editor allows 
maps and simulated 
photography to be 
provided in the 
scenario. 

- No MCOO 
functionality exists in 
the game 

5 - Excellent 
*4 - Very Good 

3 - Good 

2 - Fair 

1 - Poor 

3 of 4 present 

Trainee repeats 
analysis as neecssar>' 
to maintain a current 

a.ssessment 






Post conditions: .Answer prov ided to question; What is the terrain's cftect on the operation?: Graphical Terrain .Analysis Overlay (GT.AO) developed: 

Information that will support the development of his tactical plan is available 


Figure 11. Example of analysis with unique affordances 


If a subtask’s affordances are unique, then a simple average of the number of affordances 

present divided by the total number required provides the percentage of affordances 

available for the subtask. This percentage is compared to the rating scale (Figure 10) and 

results in a rating of 1-5 Poor to Excellent. For the example in Figure 11, the task 

requires four affordances and the evaluation determined that the scenario editor covers 

three of the four. The fourth required affordance is not present nor does the system have 

the capability of providing it. In this case we have three of four required affordances. 
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When we divide three by four we recognize the result to be 75 percent. Referring to the 
scale in Figure 10 we determine that 75 percent presence equates to a rating of 4-Very 
Good. Figure 12 depicts the process to score unique affordances. 



Figure 12. Process to score unique affordances 
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2. Sub task Affordances Previously Accounted For 

If a subtask’s affordances are completely accounted for in other analyses (referred 
to as affordance rollups), then those analyses are consulted and the ratings for their 
subtasks are obtained and averaged together to compile a numerical score for the current 
subtask under assessment. For example, if a subtask affordance requirement says see 
“perform terrain analysis” (Figure 13) then the evaluator goes to the evaluation for 
“perform terrain analysis” and collects the ratings from each of its subtasks. If more than 
one rollup is listed, then this process is executed for each of those rollups. Once all of the 
subtask scores from the rollups are collected they are summed and then divided by the 
total number of subtasks involved to obtain an average score. The average score now 
represents a number on the rating scale of 1-5 (see Figure 10). Raw scores containing 
0.50 or less are rounded down to the nearest whole number for scoring purposes. Scores 
containing 0.51 or greater are rounded up. The process is depicted in Figure 14. 
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[Partial evaluation of Conduct Mission Analysis] 


Real W orld {RW) Preconditions: Trainee has received the mission; Trainee 
has Issued a warning order (WARNO) 

Eeviroamenl Evaluation 

R^V Tasks KW Human Abilities 

RW AfTordance 
Renuirements 

Environment HA 

Environmental 

.AfTardanccs 

Level of Support lo 
Trainins 

Conduct Terrain 

Analysis 

Sec perform terram 
analysis 

Sec perform terrain 
analysis 

See perfomi terrain 
analysis 

Sec perform terrain 
analysis 

5 • Excellent 

4 - Very Good 

3 - Good 

2 - Fair 

! - Poor 

Analyze Hnemy 

Situation 

Sec analyze enemy 
situation 

Sec analyze enemy 
situation 

See analyze enemy 
situation 

See analyze enemy 
situation 

5 - Excellent 

4 - Very Good 

3 - Good 

2 - Fair 

1 - Poor 

Develop C'ommandcr 
Critical Inlonnalion 
Requirements (CCTR) 

COfIMTIVE: 

Oral Expression; Oral 
Comprehension: 

Wntten 

Comprehension: 

Written Expression; 
Deductive Reasoning: 
Inductive Reasoning: 
Problem Sensitivity; 
Mathematical 

Reasoning: Speed of 
Closure: Perceptual 
Speed; Memorization; 
Time Sharing: 

SENSORY: 

Near Vision: Speech 
Clarity: Speech 
Recognition: 

PSYCHOMOTOR: 
Manual Dexterity; 

Finger Dexterity; 

- Trainee must be 
provided with 
materials (i.e.. 
intelligence materials) 
that provide or 
support the inference 
of CCTR. 

- Tools to author, refine 
and transmitCX'IR’s 
to trainee's unit via 
voice or digital 
means. 

- A way to denote and 
link CCTR to the 
operational plan. 

COOMTIVE: 

Written 

C'omprchcnsion; 
Deductive Rea.soning: 
Inductive Reasoning; 
Problem Sensitivity 

SENSORY: 

Near Vision; 

PSYCHOMOTOR: 
Manual Dexterity: 

Finger Dcxtcniy: 

PHYSICAL: 

None 

- Scenario may provide 
higher headquarters 
C'CTR if included in 
the OPDRD. 

- No ability for the 
trainee to develop or 
denote CCTR for his 
unit or transmit CCTR 
os part of the 

COA OPORD for 
execution. 

5 - Excellent 

4 - Very Good 

3 - (iood 

2 - F‘air 

1 - I’oor 


[Evaluation for Perform Terrain Analysis] 


RW Talks 

RW Human .Abilities 

RW AfTordance 
Requirements 

Environment H.A 

Environmental 

.Affordanees 

Level of Support to 
training 

Conduct a teiram 
analysis from a map 
and matenals 
provided by the 
higher headquarters 
using the acronvm 
OAKOC (Obstacles. 
Avenues of 

Approach. Key 
Tenain. Obsenaiion 
and Fields of Fire. 
Cover and 
C'onecalmcntl. 

COGNITIVE: 

Written Comprehension: 
Deductive Reasoning: 
Inductive Reasoning: 
Problem Sensitivity; 
Visualization; Spatial 
Orientauon; Memorization 

SEN.SORY: 

Near Vision; Visual Color 
Discrimination: 

PSYCTIOMOTOR: 

Amvlland Steadiness: 
Manual Dexterity; Finger 
Dexterity: 

PHYSICAL: None 

- Paragraph 1 of 

OPORD that provides 
information from 
higher headquarters 
about the icrrain and 
weather. 

- Representation of the 
terrain that the trainee 
will maneuver over 
(e.g. map. aerial 
photographs) 

- Intelligence 
infoimation about 
enemy emplaced, 
natural or man-made 
obstacles known by 
the higher 
headquarters 

- Maneuver Combined 
Obstacle Overlay from 
higher headquarters 

COGNITIVE: 

SENSORY: 

Near Vision; Visual 

Color Discrimination; 

PSYCTIOMOTOR; 
Manual Dexterity: 

Finger De.xlerity; 

PHYSICAL: 

None 

- Sccnano editor allows 
for as much or as 
little detail as desired 
in paragraph 1 of the 
OPORD. 

- Scenario editor allows 
for as much or as 
little detail as desired 
with respect to 
intelligence 
information 

- Scenario editor allows 
maps and simulated 
photography to be 
provided in the 
scenario. 

- No MCOO 
functionality exists in 
the game 

5 - Excellent 
*4 - Very Good 

3 > Good 

2 - Fair 

1 - Poor 

3 of 4 present 

Trainee repeals 
analysis os necessary 
to maintain a current 

assessment 






Post conditions: Answer provided to question: What is the terrain's ctfect on the operation ?; Graphical Terrain Analysis Overlay (GT.AO) dcvcK>pcd: 

Information that will support the development of his tactical plan is available 


Figure 13. 


Example of analysis with rollups 
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Figure 14. Process to score affordances that have been previously accounted for 
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3. Subtask Affordances Partially Unique 

If the affordances for a subtask are partially unique and partially 
accounted for in other analyses (Figure 15), then the calculation is conducted in 
three steps. The process description that follows is depicted in Figure 17. 


Real World (RW) Precoodilions: Mussion order provided to trainee: Fire 
support assets available to the trainee arc speeitied; Trainee is knowledgeable 
on Urban Operations (UOl doctrine, the current ROE tor use of indirect 
fire, mortars and the enemy situation 

Lavirooment Evaluation 

RW Tasks 

RW Human Abilities 

KW’ AfTordance 
Reanirements 

En>'ironiiicnt IIA 

Environmental 

.Affordances 

Limit of Support to 
Trainins 

Process intormation 
concerning the ROE 
and any civil 
considerations atVccted 
by the use of indirect 
liremortais 

fUGMTIVE; 

Written 

Comprehension: Oral 
Comprehension: 
Deductive Reasoning: 
Inductive Reasoning: 
Problem Sensitivity; 
Visualization: 
Memorization 

SENSORY: 

Near Vision; Speech 
Recognition 

- ROE considerations 
dealing with indirect 
iires mortars 

- See assess civil 
considerations 

COCMTIVE: 

Wntten 

Comprehension: 
Deductive Reasoning; 
Inductive Reasoning; 
Problem Sensitivity; 
Visualization; 

SENSORY: 

Near Vision: 

PSYCHOMOTOR: 

None 

- Adjustable ROE 
setting and 
information 

- Sec assess civil 
considerations 

5 - Excellent 

4 - Very Ciood 

3 - Ciood 

2 - Fair 

1 - Poor 


HSVCHOMOTUR: 

None 


PHYSICAL; 

None 




PHYSICAL: 

None 






Figure 15. Example of a mixed evaluation (partially unique) 


a. Step One 

Treat each affordance rollup as an individual affordance that is present and 
unique. (We considered that even if a rollup score from a previous evaluation is Poor, 
some of the affordances are most likely present so we elected to initially treat all rollups 
as being present. If a case exists were none of the affordances of a rollup are present then 
that rollup affordance is considered absent.) 

b. Step Two 

Evaluate and account for the presence of any unique affordances 
associated with the subtask. Once every affordance is accounted for, the calculation for 
determining the percentage present is conducted as described in Eigure 12. The result 
(rating of 1-5) is temporarily assigned as the subtask score. Eor example, a subtask 
contains a rollup from another analysis and one unique affordance not previously 
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accounted for. The absence/presence evaluation considers the rollup as present and 
unique and the evaluator believes that the unique affordance item is also present. This 
information results in the assignment of an initial score of 5 for the subtask [2 
affordances required, 2 present 2/2 =100 percent 5-Excellent]. 

c. Step Three 

Obtain the values (scores) for the subtasks from the previous analyses 
(Figure 16) as described in “subtask affordances previously accounted for” and sum 
them. Add the temporary value for the subtask currently under evaluation from step two 
[our example from step two = 5]. Average this value by the total number of subtasks 
(including the current one). The derived number represents a number on the scale 
between 1 and 5 (see Figure 10) that when rounded appropriately (0.50 and lower round 
down) provides the rating for this subtask. 


Real World (KW) Prcconditioos: I'rjmcc is familur wtth dcKtnnal 
description ot' assessment IFM 5-Ok Trainee has knowledge and 
understanding about civil considerations: I'ramec receives current 
infomiation regarding important civil considerations in his AO. 

Environment Evaluation 

No information concerning civil considerations within the AO is provided to 
the Trainee by the game or the scenarios violating this nect^ssary 
precondition. 

KW Tasks 

RW Human .Abilities 

RW Affordance 
Rrauircmcnti 

Environment II.A 

Environmental 

Affordances 

Level of Support (0 | 

TraininE 1 

ITaince develops or 

COGMTIVE: 

- Example assessment 

COGNITIVE: 

- None 

S - Excellent 

adopts an existing 

Written lixpression: 

mechanism 

Fluency of Ideas; Speed 


4 - Very Good 

assessment mechanism 

Oral Expression; 

- Tools to develop an 

of Closure; Inductive 


3 - Good 

to categorize civil 

Fluency of Ideas; Speed 

assessment 

Reasoning: Deductive 


2 - Fair 

considerations. 

of C'lo.surc: Inductive 
Reasoning; Deductive 
Reasoning; Problem 
Sensitivity; Originality; 
Category’ Flexibility: 
Memorization 

SENSORY: 

Near vision; 

PSYCHO.MOIOR: 
Manual Dexterity; 

Finger Dexterity 

PIIYSIC.AL: 

None 

mechanism le.g., 
mission command 
systems, pens, paper, 
etc.) 

- Way to visualize 
assessment 

Reasoning: Problem 
Sensitivity; Originality; 
Category Flexibility; 
Memorization 

SENSORY: 

Near Vision 

PSVCHO.MOIOR: 
Manual Dexterity; 

Finger Dexterity 

PHYSICAL: 

None 


1 - Poor 

Trainee gathers and 

COC;Mn\E:Oral 

~ Inlormation about the 

co<;mti\e: 

- Scenario editor 

5 - Excellent 

processes all available 

comprehension; Written 

civilian population. 

Written 

provides the ability to 

4 - Very Good 

inlormation about the 

comprehension; 

government and urban 

Comprehension; 

have as much or as 

3 - Good 

civil considerations in 

Inductive Reasoning; 

landscape. 

Inductive reasoning; 

little information 

2 - Fair 

his AO. 

Problem Sensitivity: 
Infornution Ordering: 
Speed of Closure 

SENSORY: Near 

Vision 

- Known friction points 
between civilian 
population and 
ificndly forces 

- Known problems 
within the civilian 

Problem Sensitivity 

SENSORY: 

Near Vision 

PSVCHO.MOIOR: 
Manual Dexterity; 

about the population 
as desired. This 
infonnalion would 
come from the BN 
OPORD. 

- System does not 
provide any way to 

1 - Poor 


Figure 16. Partial evaluation for assess civil considerations 
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Figure 17. Process for scoring affordances that are unique and previously 

accounted for 


4. Subtask Affordances Contained in Multiple Analyses 

In the case where a task’s affordances are accounted for in multiple nested layers 
of sub-analyses, we have elected to stop the decomposition at the top of the second nested 
level. Figure 18 depicts the nested analysis problem. In such a case the top-level raw 
score of the high-level task at the second nested level is used in the value calculation for 
the current subtask. The process to address this situation is shown in Figure 17 beginning 
at the second triangular decision node. By our estimation, conducting further 
decomposition during the analysis leads to inflated results. 
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Current high-level task 
under investigation 



Level 2] 


Figure 18. Depiction of nested layers of analysis 


C. PROCEDURE FOR TASK SCORING 

High-level tasks also are scored using the scale seen in Figure 10. The procedure 
to score a high-level task consists of summing all of the subtask scores and dividing them 
by the total number of subtasks. For example, if a high-level task has only one subtask 
score then that is the score for the high-level task. Another example might be a high-level 
task with multiple subtasks scored at 4,3,5,3,5 and 4. These subtask scores are summed 
(4-I-3-I-5-I-3-I-5-I-4 = 24) and then divided by the total number of subtasks (6) resulting in 
24/6 = 4 that equates to a rating of Very Good. Scores containing a decimal of 0.50 or 
lower are rounded down. 

D. SUMMARY 

Analytical methodologies to assess simulations are not new. What is novel here is 
the perspective we have taken with ITEAM. ITEAM offers a systematic approach to 
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assess an ITE using the human rather than technology as the focal point. TA annotated 
with the corresponding human abilities, guides the identification of necessary affordances 
within the ITE. Once identified, affordances are used to determine the level of support for 
the practice of specific tasks. If applied as described, ITEAM provides an effective 
process to determine the utility of integrated training environments. 
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IV. CASE STUDY I: GAME-BASED TRAINING IN AN 
OPERATIONAL SETTING 

This study re-examined the training effectiveness analysis (TEA) study of game- 
based training using Virtual Battlespace 2 (VBS2): U.S. Army (USA). Version 1.23 of 
VBS2 was used in the original evaluation. Unfortunately, that version of the software was 
not available for this analysis so version 1.40, resident on the U.S. Marine Corps (USMC) 
Deployable Virtual Training Environment (DVTE), was used. While this version of the 
software was technically VBS2: USMC and newer, it contained all of the same base 
models and behaviors as VBS2: USA. Personnel working in the TRADOC capability 
manager for gaming (TCM-Gaming) office confirmed this fact. To avoid any confusion 
in the discussion below, the general acronym VBS2 is used. 

A. METHOD 

1. Brief Description of Empirical TEA Study 

In 2009, TCM-Gaming in conjunction with the Army Research Institute (ARI) 
and Aptima Inc., conducted research designed to empirically shed light on the issue of 
game-based training effectiveness (Ratwani, Orvis, & Knerr, 2010). The study employed 
observational methods to several small unit events at the USA installations of Eort Hood 
Texas and Eort Eewis Washington to collect data in support of six hypotheses. The 
purpose of the TEA was to study the overall effectiveness of VBS2 and the impact of 
situational variables on training outcomes. Situational variables were used to build 
metrics that supported measuring skill acquisition during training. The measures applied 
as part of the evaluation protocol were skill preparedness, training motivation, task 
performance, unit process, unit cohesion, unit efficacy, and unit effectiveness. Surveys 
designed to gather data for each of these measures were used. 

2. Application of ITEAM to VBS2 Based ITE 

During this study, the full range of ITEAM processes and sub-processes were 

employed as depicted in Eigure 6. The introduction of the game-based training 

effectiveness TEA stated the following as the USA’s need. “The Army needs methods for 
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providing soldiers and leaders with effective training and opportunities to practice tasks 
effectively and efficiently” (Ratwani et al., 2010, p. 1). Supporting this statement of need 
was additional language indicating that USA personnel were already exploiting low-cost, 
technology-based solutions and innovative training methods in order to increase the 
impact and effectiveness of training. TRADOC, a significant stakeholder in the USA 
training and educational domain, “recognized that games have the potential to augment 
and improve [emphasis added] military training for both individuals and collectives” 
(Ratwani et ah, 2010, p. 1). This recognition was based on the USA’s use of the games 
DARWARS Ambush! and Tactical Iraqi for convoy and language training support. The 
need stated in the TEA serves as a point of departure for this analysis but provides little 
assistance to our efforts. According to Ratwani et al. (2010, p. 1) the USA needs 
“methods for providing soldiers and leaders with effective training” and “opportunities to 
practice tasks.” The former statement is extremely vague and the later has to do with time 
not ITEs. The meanings of “effectively” and “efficiently” all depend on how the USA 
defines the terms. 

The operational concept for employing game support to the deliberate practice of 
skills in this specific instance was a controlled classroom setting. A stated assumption of 
the TEA was that this training was the “crawl” part of the USA’s crawl, walk, run tiered 
training approach. The tactical scenario on which the evaluation was based and most of 
the training occurred revolved around combat convoy operations. One of the base 
concepts for operations (CONOPS) used for the training at Eort Hood may be seen in 
Appendix C. Trainees utilized both desktop and laptop computers with standard 
keyboards, mice and headsets that allowed for their control and communication. 
Commercial off-the-shelf (COTS) vehicle controls were available for use by trainees 
designated as vehicle drivers. Synthesis of this operational concept, tactical scenario and 
individual feedback from Eort Hood and Eort Eewis, resulted in the general recognition 
that VBS2 support to the deliberate practice of tasks was mainly cognitive and sensory in 
nature. The functional allocation derived from the available information supported this 
conclusion. VBS2 provided the entire stimulus and scenario environment where soldiers 
would control subject avatars to execute specific activities. Classroom space at the local 
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mission command training center (MCTC) provided the physical environment and 
surroundings. The scenario development capability was part of VBS2. The unit leader 
and/or the civilian controller at the MCTC executed all scenario manipulations. Soldiers 
were represented in the game environment via avatars. Trainees accomplished avatar 
control through the use of the keyboard and mouse. Trainees were responsible for vehicle 
control using a steering wheel/pedal interface. Enemy actions were controlled by VBS2 
artificial intelligence or by a MCTC employee. All equipment and vehicles necessary to 
conduct mission practice were provided by VBS2 within the game scenario. 

The task analysis (TA) conducted in support of this effort began using the 13 
items listed as skill preparedness items in the TEA. Additional tasks were listed under 
task performance, but those items were interpreted as the tasks necessary to use VBS2 
(i.e., avatar control “buttonology”) and were not included in the TA. Each skill was used 
to search for relevant doctrine in the Central Army Registry (CAR). The CAR subsumed 
what was previously called the Reimer Digital Eibrary (RDE). Eor each skill multiple 
doctrinal references were consulted and used to develop the TA. Eor those readers 
interested in viewing the TA, it may be found at Appendix D. The training objectives 
used to guide the conduct of the units training were not available for our ITEAM 
assessment of VBS2. 

The real-world human ability (HA) inventory associated with the TA was 
conducted by reviewing each of the 52 HA (Eleishman & Quaintance, 1984). Those 
determined to be applicable were listed next to the tasks and subtasks. The rule of thumb 
applied to this process was to err on the side of commission versus omission. Only a 
small amount of iteration was applied to refine the HA list for this study due to time 
constraints. Affordance lists flowed from the description of the tasks as well as the 
human abilities associated with the tasks. 

HA supported by the game, were identified by conducting an HA inventory 
reviewing each task/subtask with the list of 52 HA to determine which were related to 
game play or manipulation of the game. Example questions that guided this sub-process 
may be viewed at Appendix B. 
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The affordance inventory for VBS2 was conducted in the following manner. First 
a facsimile of the TEA study ITE was developed using one DVTE suite consisting of four 
laptop computers, headsets, mice and keyboards. The laptops were connected in a closed 
loop network so that four individuals could participate together as a crew. One station 
was equipped with a steering wheel and pedals and was designated as the driver station. 
Next we played the three built-in training scenarios that VBS2 provided. Eollowing this 
exposure, we investigated the model library available to all users and developed several 
small-scale vignettes to better understand the capabilities of the scenario editor. During 
this process we contacted personnel at the Eort Hood MCTC and the TCM-Gaming office 
with questions about game capability. Einally, we enlisted the aid of one Army officer 
who had experience as a trainer and developer of VBS2 scenarios to help us develop and 
work through focused vignettes. Scoring of affordances, subtasks and high-level tasks 
was conducted as described in the previous chapter. Results of the assessment may be 
seen in Appendix D. 

B. DISCUSSION 

I. VBS2 TEA Results 

Readers interested in the full results of the TEA should view (Ratwani et ah, 
2010). The results presented here for comparison are those items investigated to shed 
light on the skill preparedness of the trainees both before and after using VBS2. 
Subjective questionnaires were used as the data collection method for the original TEA. 
The questionnaires asked subjects to rate their preparedness both prior to and post 
training with VBS2. Table 1 depicts the post-training results of the seven items 
reinvestigated as part of this case study. 141 participants in two locations were asked 
their opinions of their preparedness to conduct the activities listed after conducting 
convoy training in VBS2. TEA scoring used an ordinal scale ranging from 1-5 with 1 = 
Unprepared; 2 = Slightly Prepared; 3 = Neither Unprepared nor Prepared; 4 = Slightly 
Prepared; and 5 = Prepared. The scores were averaged and the mean results are provided 
below by task in order based on preparedness level ranked from highest to lowest. 
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Table 1. Skill preparedness results of VBS2 TEA 


Skill Preparedness Item 

Mean Score 

Scan my sector of responsibility 

4.35 

Comply with rules of engagement 

4.29 

Communicate with members of your unit 

4.13 

React to lED 

4.04 

Coordinate activities with your chain of command 

3.90 

React to an attack 

3.85 

Conduct CASEVAC/Recovery Operations 

3.75 

Scale 

5—Prepared 

4—Slightly Prepared 

3—Neither Unprepared nor Prepared 

2—Slightly Prepared 

1—Unprepared 


2. ITEAM Results 

Table 2 depicts the results of the ITEAM assessment of VBS2 1.40. During the 
assessment, only seven items were reevaluated due to a time constraint on the study. One 
of the seven (Conduct CASEVAC/Recovery Operations) was broken into two tasks to 
simplify the analysis and then remerged for purposes of comparison. The full analysis 
may be viewed at Appendix D. 

At the outset of the evaluation we recognized that the myriad of physical tasks 
associated with the skills under investigation could not be supported using VBS2. Our 
evaluation discovered that VBS2 contains many if not all of the affordances we listed as 
necessary for the deliberate practice of the skills. This result led to one interesting 
question and one interesting finding. 

Since VBS2 was initially designed as a first-person shooter game where players 
control an avatar that conducts actions directed by the player, is it possible that a soldier 
can be trained in an activity if he controls his avatar? Discussion of this question with 
other researchers, soldiers and civilians who support the development of TTEs has 
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reached similar conclusions. No, it is not acceptable to assume that soldiers are trained 
simply because they control their avatar properly through a process or action. 


Table 2. Results of ITEAM assessment of VBS2 


Skill Preparedness Item 

ITEAM Score 

Scan my sector of responsibility 

5.00 

Comply with mles of engagement 

5.00 

Communicate with members of your unit 

3.66 (VG) 

React to lED 

5.00 

Coordinate activities with your chain of command 

5.00 

React to an attack 

5.00 

Conduct CASEVAC/Recovery Operations 

3.42 (G) 

Scak- 


5—Excellent: ITE contains all but a few (90-100%) of the alTordances detemiined necessary 

4—V'ery Good: ITE contains a significant portion (70-89%) of the affordances determined necessary 

3—Good: ITE contains a good portion (50-69%) of the affordances determined necessary 

2—Fair: ITE contains some (25—49%) of the affordances determined necessary 

1—Poor: ITE contains very few (0-24%) of the affordances determined necessary 


We believe that this highlights an intuitive finding that game ITEs are better 
suited to support the practice of cognitively dominant tasks. In VBS2 it is possible to 
extract a wounded soldier from a damaged vehicle, drag him to a non-standard medical 
vehicle where he can be evacuated. VBS2 goes so far as to automatically place the 
casualty in the evacuation vehicle. Practice of the cognitive tasks of assessing the 
situation and taking the appropriate actions are definitely supported. However, the 
physical tasks of lifting and dragging the casualty, opening doors, and walking are not 
supported even though the trainee controls the avatar that does those physical actions. 

The finding involved bias and its effect on assessment. Our bias against a game’s 
ability to usefully support the deliberate practice of tasks involving physical skills almost 
derailed our ability to objectively assess the capabilities of VBS2. This dilemma occurred 
even though we were following a logical process to conduct our assessment. If evaluator 
bias is capable of derailing assessment when a logically unbiased process is used, what 
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can we expect if and when no logical process is used? This situation strengthens our 
belief that a methodical process must be enforced and used during ITE assessment. 

C. CONCLUSIONS 

Table 3 provides a comparative view of the results from the game-based training 
effectiveness TEA and the TTEAM analysis. Attempting to determine the utility of VBS2 
to support specific task/skill training from this TEA is dangerous considering the source 
of the data used to statistically support the conclusions. Using subjective trainee surveys 
that rely on a unit’s training program as the basis to build conclusions on the 
effectiveness of game-based TTEs is wrong. Contributing factors to unit readiness such as 
leadership involvement in the training program, unit cohesiveness, efficacy, 
effectiveness, motivation, and preparedness for training all reflect on a holistic unit 
training program, but not the ITE. 

The ITEAM assessment used a foundation of Army doctrine, procedures and 
derived tasks that facilitated a systematic review of the VBS2 ITE. The focus of the 
assessment was on the ITE itself and it’s ability to support the deliberate practice of the 
tasks associated with seven skill preparedness items. The comparison of results between 
ITEAM and the TEA are coarse, but promising. While we draw no definitive conclusions 
from this case study, we are encouraged that we might be on the right track. When 
viewing the evaluations side by side it can be seen that ITEAM agreed with the original 
TEA that support for “communication with members of your unit” was at the level of a 4 
(somewhat prepared [TEA], very good [ITEAM]). Additionally, soldier assessments and 
ITEAM both agreed that the environment least supported the deliberate practice of 
conducting CASEVAC and recovery operations. 
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Table 3. Comparison of TEA results and TTEAM assessment 


Skill Preparedness Item 

TEA Score 

ITEAM Score 

Scan my sector of responsibility 

4.35 

5.00 

Comply with rules of engagement 

4.29 

5.00 

Communicate with members of your unit 

4.13 

3.66 

React to lED 

4.04 

5.00 

Coordinate activities with your chain of 
command 

3.90 

5.00 

React to an attack 

3.85 

5.00 

Conduct CASEVAC/Recovery 

Operations 

3.75 

3.42 


The TEA used in this case study represents a good example of the USA’s 
misunderstanding and misuse of the words training, skill, and task and adds yet another 
piece of rigorous anecdotal support to the notion that games are useful. The soldiers who 
participated in the original study received the knowledge of how to employ the skills 
(collection of particular abilities) necessary to execute the tactical tasks (pieces of work) 
prior to the exercise event as part of a training program. This knowledge was not 
provided to them by VBS2. Eurthermore, VBS2 represents a good example of a game 
that ‘trains’ users how to use it (i.e., the game). Training in this context describes the 
process where information is imparted through the use of visual and aural means that is 
then practiced. VBS2 training consists of three scenarios designed to allow users to 
practice controlling game play using the keyboard, mouse and menu options. VBS2 does 
provide a tool that may be used to practice specific skills linked to specific training 
objectives (desired outcomes). Assumed intentionally vague, the conclusion that VBS2 
positively impacts the training outcome of skill preparedness is indisputable, but 
meaningless. We need to dig deeper. 
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V. CASE STUDY II: FULL SPECTRUM COMMAND 


This chapter describes the reanalysis of the game Full Spectrum Command (FSC) 
to determine its utility to support the execution of 22 action items (high-level tasks). One 
person conducted this study over a period of four months. 

A. METHOD 

FSC was developed in 2004. Access to stakeholder discussions, front-end analysis 
and requirements documentation proved elusive. However, the redacted FSC training 
effectiveness evaluation (TEE) provided information for ITEAMs requirements definition 
process. Erom the TEE, the infantry captain’s career course (ICCC) and infantry school 
stated a desire for 

• A capability that would allow their students to conduct mission analysis 
and planning 

• Experience decision-making requirements that occur during mission 
execution 

• Enhance their ability to adapt to emerging threats and changing conditions 
on a simulated battlefield and 

• Repeated opportunities to practice and actually experience the 
consequences of executing or changing their operational plans in response 
to emerging conditions on the battlefield (Beal & Christ, 2004). 

Specific needs or measurable performance shortfalls were not identified in the 
TEE, so we focused our attention on the intent of the ICCC to provide trainees with 
experience in developing plans and reacting to changes in their plans during contact. We 
did not assume what improved performance looked like, rather we inferred the intent for 
the ITE was to support deliberate practice and that performance improvement would be 
judged using some other instrument within the ICCC program of instruction (POI). 

Next we turned our attention toward how the stakeholders envisioned ESC 
supporting the ICCC and any information that revealed what functions were specified for 
the game. Subject matter experts (SMEs) who worked at the infantry school and were 
involved with the development and evaluation of ESC provided feedback that indicated 
ESC was not initially intended for use within the ICCC POI. They were unaware of any 
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discussions of system functionality or intent of system implementation within the ICCC 
POL Stakeholder expectations of system users were absent from the FSC TEE. We 
inferred general system and trainee functional allocations based on statements referring to 
adaptive decision-making and deliberate practice. The TEE did mention the following 
characteristics of ESC, which provide limited insight into some of the desired system 
functionality. 

• ESC permits players to respond to emerging battlefield conditions. 

• ESC permits players to practice behaviors necessary to acquire and 
maintain adaptive decision-making skills in a realistic and dynamic 
tactical environment. 

• ESC has the capability to replay specified portions of mission execution 
facilitating performance feedback. 

It remains unclear what specific behaviors are necessary to “acquire and maintain 
adaptive decision-making skills” (Beal & Christ, 2004, p. 2). 

The original TEE did not contain or allude to any job or TA that was conducted in 
support of the development of ESC. In order to initialize this critical stage of analysis, we 
decided to use the ICCC action items listed as part of the survey instrument given to the 
trainees. The action items provided the best starting point for the development of a TA to 
help describe the training that ESC needed to support. Initially, all action items were 
reviewed and the doctrine that governed their description consulted. Since ESC was 
intended for use at the company commander level, we reviewed doctrine from the Army 
level down to the company level (i.e., EMs 3-0, 3-21.8, 3-21.10 and 5-0), including any 
specific doctrine for a warfighting function covered by ESC (e.g., breaching and 
engineers). This review of doctrine ensured that we had a good understanding of how 
infantry officers and their attached assets operate together in tactical, operational and 
strategic environments. During the review it was discovered that many of the appropriate 
manuals had been updated since ESC was originally evaluated. The refresh of the 
doctrine did not adversely affect our assessment because no changes were made to the 
USA troop leading procedures or the military decision making process. 

Eigure 18 depicts an organized hierarchy of the action items based on USA 
doctrine. We recognized early that many of the action items listed for evaluation were 
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sub or sub-sub processes of a larger military analysis procedure and that the ICCC was 
not necessarily interested in using FSC to support the entire process. Placing the items 
into the hierarchy seen in Figure 19 provided context for the conduct of the TA. 
Organizing the action items in this fashion assisted us with identifying the pieces we 
needed to assess. 



The format used for the TA is one commonly found in graphical user interface 
(GUI) design (Gieskens & Foley, 1991; Vonguru, 1995). The format consists of listing 
preconditions for the desired actions and then the critical tasks followed by any post¬ 
conditions resulting from the actions taken. The precondition/task/post-condition format 
is nicely suited to evaluating tasks supporting military training systems. Several iterations 
of review were executed to refine the TA. The TA reflects our experience in the military 
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domain and was reviewed by several infantry officers to gain consensus with the level of 
detail provided. Readers wishing to see more information about the TA are referred to 
Appendix E. 

Details harvested from the ESC TEE included one terminal-learning objective: 

The ICCC course terminal learning objective for this week is for the 
student to demonstrate an improvement of his visualization of the tactical 
problem and an ability to describe his plan for executing and 
synchronizing a light company course of action in urban operations. (Beal 
& Christ, 2004, p. 3) 

As part of their public information campaign to promote ESC, the Institute for 
Creative Technologies (ICT) stated that the military decision-making process (MDMP), 
course of action (COA) development and COA adaptation were also learning objectives 
for the game. The ITEAM assessment of ESC indicates that these objectives are 
supported to a certain extent, but without measures of effectiveness and performance, 
determining success on these learning objectives is impossible. 

The human ability requirements (HA) associated with the various tasks reflect the 
kinds of things that are required of the human when executing the task elements. Each 
task item was screened against all 52 HA to determine which ones were required to 
accomplish the task. HA were listed by category (i.e., cognitive, sensory, psychomotor or 
physical). The designation of the abilities by category greatly assisted in identifying the 
kind of training ESC was best suited for (i.e., cognitive decision making versus physical 
reconnaissance). Several reviews of the abilities and their definitions resulted in a fairly 
consistent application across each action item. 

Affordance requirements were derived from the description of the tasks and the 
HA associated with them. Initially, affordances were described in a purposefully vague 
manner (e.g., a way to draft a plan). Review by military SMEs and discussion with other 
researchers, resulted in the addition of detail to the affordance requirements. Affordance 
requirement descriptions evolved over several iterations of review and were not easily 
constructed. Many of the same affordances showed up in several different places 
throughout the analysis. 
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The HA supported by the ITE were discovered by answering questions like “how 
do soldiers do this in the game and what HA are supported by the game to accomplish the 
task?” Interestingly, little difference was identified regarding real world and system 
supported HA for most of the cognitive activities. Noticeable differences were seen in the 
application of physical abilities. 

Determining ESC affordance resources in the ITE was done through multiple 
iterations of document and game review. We first conducted a thorough review of the 
redacted ESC TEE and user manual followed by game play. The review of the user’s 
manual and scenario editor highlighted many capabilities that resulted in the high positive 
feedback by the ITEAM methodology. The game was evaluated by playing each scenario 
and by careful investigation of the scenario editor. After this activity, each action item 
was revisited and annotated with the affordances that we identified as being present. 

Table 4 depicts the results of analysis from each individual action item in the ESC 
report and subsequently by ITEAM. Interested readers will find the individual analyses 
for each action item located in Appendix E. Mean scores were chosen for comparison 
between the two forms of evaluation so that the two methods of assessment could be 
evaluated fairly. The ESC TEE mean rating scores listed in Table 4 were compiled from 
survey opinion data provided by a group of USA ICCC students asked to rate FSC’s 
ability to support the 22 action items listed. Student scoring was conducted using a four- 
point scale of 1 = Not at all; 2 = Not very well; 3 = Moderately well; and 4 = Very well. 
ITEAM scoring used a five-point scale (Eigure 10) where 1 = Poor; 2 = Eair; 3 = Good; 4 
= Very Good and a 5 = Excellent. The ESC TEE did not assign overall ratings for the 
games ability to support training the action items (column “support level”). We have 
provided the overall ratings here to enable comparison. One assumption made during this 
comparison is that the rounding of scores 0.50 and below was downward which is the 
same way we handled scores containing 0.50 or below in ITEAM. 
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Table 4. Summary of original five-point TTEAM and four-point FSC report evaluations 


Action Item 

FSC report 
support level 

FSC Mean 

ITEAM 
Assessed Level 

ITEAM Mean 
Rating 

ESC/ITEAM 

Agreement 

Y/N 

Analyze civil considerations 

Not very well 

2 

Fair 

2.0 

Yes 

Analyze the enemy situation 

Moderately well 

3.2 

Very Good 

3.67 

No 

Apply selected defensive considerations to 
develop a tactical plan 

Not very well 

2.4 

Not Evaluated 

Not Evaluated 

NA 

Apply selected steps of the troop leading 
procedures 

Moderately well 

3 

Good 

3.25 

Yes 

Apply the fundamentals of conducting a 
movement to contact (MTC) 

Moderately well 

2.7 

Very Good 

4 

No 

Conduct an after action review for a light 
infantry company 

Moderately well 

3 

Good 

3 

Yes 

Conduct mission analysis 

Moderately well 

3 

Good 

3.36 

Yes 

Conduct reconnaissance 

Moderately well 

2.8 

Good 

2.66 

Yes 

Develop a course of action for a light 
infantry company team 

Moderately well 

3.5 

Good 

3.5 

Yes 

Determine own force potential combat 
power 

Moderately well 

3.3 

Excellent 

5 

No 

Integrate fire support into urban operations 

Moderately well 

2.8 

Very Good 

4 

No 

Integrate selected fundamentals and specific 
planning considerations of the offense in an 
urban environment 

Moderately well 

2.9 

Not Evaluated 

Not Evaluated 

NA 

Integrate the fundamentals and techniques 
of the offense into a course of action 

Moderately well 

3.0 

Good 

3.28 

Yes 

Issue a company/team OPORD 

Not very well 

2.2 

Good 

3 

No 

Issue a FRAGO 

Moderately well 

3.2 

Very Good 

4 

No 

Issue OPORD for infantry company 
(redundant) 

Not very well 

2.2 

Not Evaluated 

Not Evaluated 

Na 

Perform terrain analysis 

Moderately well 

2.6 

Very Good 

4 

No 

Plan breaching operations 

Moderately well 

3.0 

Very Good 

4 

No 

Select a course of action (COA) 

Moderately well 

3.3 

Good 

3 

Yes 

Synchronize a light company team attack in 
an urban operation 

Moderately well 

2.9 

Good 

3.35 

Yes 

Synchronize the engineer portion of a light 
infantry company attack 

Moderately well 

2.6 

Good 

3.37 

Yes 

Synchronize the indirect fires portion of a 
light infantry company attack 

Moderately well 

2.9 

Good 

3.35 

Yes 
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Students scored the game based on their interaction with it during hands-on play, 
observational play, demonstration and training on how to use the game. The FSC TEE 
reflected the student exposure time as shown in Table 5. Based on Table 5, we inferred 
that, on average, students based their assessment of ESC’s ability to support training on 
7.8 hours of various types of exposure to the game. This exposure time was not 
continuous but occurred over a period of one week. As mentioned previously, we 
conducted the ITEAM assessment of ESC over a period of four months with the majority 
of that time being spent on data mining the literature and doctrine as well as playing the 
game. 

Table 5. Mean (SD) time of exposure to ESC in minutes (from Beal & Christ, 2004) 


Demonstration and 
Train-up (min) 

Hands-on FSC Play 
(min) 

Observational FSC Play 
(min) 

288 (73) 

120(95) 

168(81) 


B. DISCUSSION 

After conducting a thorough investigation of the capabilities of ESC, we 
generated the results available in Table 4 and reflected graphically in Eigure 20. 
Comparison of results between the TEE and ITEAM showed that ITEAM consistently 
rated ESC capability higher than the TEE. We speculated that one possible explanation 
for ITEAMs consistently high scores might have to do with the differences in scale 
between the TEE and ITEAM. 
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FSC 4-pt/ITEAM 5-pt Mean Scores Comparison 
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Figure 20. Comparison of initial mean seores between ITEAM and FSC 
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In an attempt to adjust for the differenees in seoring, the ITEAM seale was adjusted from 
a five-point seale to the four-point-seale shown in Figure 21. Seoring of affordanees and 
overall rating of aetion items was re-condueted similarly to the original analysis only now 
using the four-point seale. The revised individual analysis results are available in 
Appendix F and may be viewed graphieally in Figure 22. As expected, this change 
enabled better alignment between the ITEAM and TEE results. 


Scale Definition 

4-Verv Good - the ITE contains a significant portion (75-100%) of the affordanees 
determined during the analysis 

3 Good - the ITE contains a good portion (50-74%) of the affordanees determined 
during the analysis 

2-Fair - the ITE contains some (25^9%) of the affordanees determined during the 
analysis 

1 Poor - the ITE contains very few (0-24%) of the affordanees determined during the 
analysis 


Figure 21. Revised four-point scale definition for ITEAM/FSC comparison. 


One final adjustment to the data analysis allowed us to reach our final comparison 
values. Since neither the ESC TEE nor ITEAM scales contain decimal values we rounded 
all of the scores so that they would match the rating scales. This adjustment provides us 
with the graphical view of the data seen in Figure 23. Figure 23 demonstrates that in a 
comparison using equivalent scales, we were able to predict 13 of the 19 ratings given to 
ESC by a group of 24-26 infantry officers. Based on the number of evaluations attempted 
(19), this results in a success rating of 68 percent. Table 6 provides the four-point scale 
data results side by side for comparison. 
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Comparison of 4-point scales raw means 
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Table 6. Final summary of ITEAM and ESC report evaluations of ESC action items. 


Action Item 

FSC TEE support 
level 

ESC 

Rounded 

Mean 

ITEAM 
Assessed Level 

ITEAM Scaled 
Rounded Mean 

ITEAM 

Agreement with 
ESC TEE Y/N 

Analyze civil considerations 

Not very well 

2 

Fair 

2 

Yes 

Analyze the enemy situation 

Moderately well 

3 

Good 

3 

Yes 

Apply selected defensive considerations 
to develop a tactical plan 

Not very well 

2 

Not Evaluated 

Not Evaluated 

NA 

Apply selected steps of the troop leading 
procedures 

Moderately well 

3 

Good 

3 

Yes 

Apply the fundamentals of conducting a 
movement to contact (MTC) 

Moderately well 

3 

Very Good 

4 

No 

Conduct an after action review for a 
light infantry company 

Moderately well 

3 

Fair 

2 

No 

Conduct mission analysis 

Moderately well 

3 

Good 

3 

Yes 

Conduct reconnaissance 

Moderately well 

3 

Fair 

2 

No 

Develop a course of action for a light 
infantry company team 

Moderately well 

3 

Good 

3 

Yes 

Determine own force potential combat 
power 

Moderately well 

3 

Very Good 

4 

No 

Integrate fire support into urban 
operations 

Moderately well 

3 

Good 

3 

Yes 

Integrate selected fundamentals and 
specific planning considerations of the 
offense in an urban environment 

Moderately well 

3 

Not Evaluated 

Not Evaluated 

NA 

Integrate the fundamentals and 
techniques of the offense into a course of 
action 

Moderately well 

3 

Good 

3 

Yes 

Issue a company/team OPORD 

Not very well 

2 

Good 

3 

No 

Issue a FRAGO 

Moderately well 

3 

Good 

3 

Yes 

Issue OPORD for infantry company 
(redundant) 

Not very well 

2 

Not Evaluated 

Not Evaluated 

NA 

Perform terrain analysis 

Moderately well 

3 

Very Good 

4 

No 

Plan breaching operations 

Moderately well 

3 

Good 

3 

Yes 

Select a course of action (COA) 

Moderately well 

3 

Good 

3 

Yes 

Synchronize a light company team 
attack in an urban operation 

Moderately well 

3 

Good 

3 

Yes 

Synchronize the engineer portion of a 
light infantry company attack 

Moderately well 

3 

Good 

3 

Yes 

Synchronize the indirect fires portion of 
a light infantry company attack 

Moderately well 

3 

Good 

3 

Yes 


86 




C. CONCLUSIONS 

The original FSC TEE collected data from the participants involved in the study 
through the use of various survey items. An empirical test using a robust simulation was 
designed and executed to collect data pertaining to student performance. Considerable 
statistical analysis was executed on the data collected to draw conclusions. In the end, as 
the report states, the results were inconclusive, meaning evaluators were unable to 
determine the training effectiveness of ESC. Reasons stated for this were the result of 
unforeseen obstacles to the empirical protocol as well as the lack of any identified 
improvement of decision-making by the trainees. Perhaps the result was due to the lack 
of focus on ESC and too much focus on soldier performance. While improvement in 
performance is a good measurement to indicate the value of an ITE, it only works if the 
capabilities of the system are known beforehand and applied appropriately. 

As we investigated ESC and applied our analytical methodology, several things 
came to light about the original TEE. Eirst, ESC was never the main focus of the ARI 
study; rather it was an enabler to the larger investigation into adaptive decision-making. 
We believe that categorizing this study as a TEE of ESC was inappropriate. Second, 
opinions of users who were unfamiliar with the full capability of ESC, ISD/SAT and the 
tasks, were relied upon to judge the utility of ESC. These same users based their opinions 
on scenarios that we believe were incomplete, possibly by design. So instead of providing 
a full picture of the capabilities of ESC and requesting feedback, users were only exposed 
to some of the capability of ESC and then offered their opinions. The attempt to 
statistically infer the value of ESC based on decision-making style and personal 
information did not lead to an accurate picture of FSC’s utility or potential. 

During our initial review of FSC, we felt that the game was not suitable for 
military training at all (evaluator bias). However, after we conducted our analysis using 
ITEAM, that opinion was drastically changed. Merely passing judgment based on 
opinions is not as effective or reliable as basing opinions on structured analysis. Users 
were never asked whether ESC supported the accomplishment of any specific tasks. They 
were asked whether they felt that the game allowed them to conduct certain action items. 
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If asked to decompose those actions and then consider the human abilities needed to 
conduct them, we believe that students would have adjusted their assessments. 

Despite our desire for a larger number of matches to the TEE we were able to 
predict the level of support provided by ESC for 13 of 19 items. Eour of our evaluations 
were higher (more positive) than those of the TEE and two were lower (more negative), 
which leads to the question of why are they different? We believe the answers can be 
found in the consistency in application of ITEAM and user opinion. Inconsistent 
application of a process leads to inconsistent results. During our review and scoring 
adjustment of ITEAM, it became apparent that in several instances we might have treated 
the same or similar affordances differently in parts of our evaluation. We believe that in 
at least one case, this action directly resulted in our rating being higher than that in the 
ESC TEE, which when rounded, resulted in an ITEAM result being higher than the TEE 
rating. The level of knowledge supporting an opinion is important. We believe that a 
more powerful reason for the difference in ratings is the result of ESC users not being 
fully aware of the capabilities of the game during their evaluation and basing many of 
their ratings on the limited game scenarios they interacted with. 
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VI. CASE STUDY III: EST 2000 HEAVY WEAPONS TRAINER 


A. METHOD 

ITEAM was used in this study to reexamine the Engagement Skills Trainer (EST) 
2000. The TRADOC Analysis Center (TRAC), White Sands Missile Range (WSMR) 
conducted a training effectiveness analysis (TEA) of EST 2000 heavy weapons training 
in March of 2008. The focus of the TEA was to determine if the use of the EST could 
mitigate the impact of ammunition shortages for the M2 .50 caliber Browning machine 
gun and the MK19 modification 3, 40 millimeter (mm) grenade machine gun on soldier 
proficiency (Hughes & Nau, 2008). The EST 2000 is described as a laser-based 
unit/institutional, indoor, multi-purpose arms trainer that displays targets, terrain and 
weapon effects in a real-time, three dimensional presentation on a screen that is 26 feet 3 
inches from the firer (Hughes & Nau, 2008). The system has 11 different types of 
weapons that may be used for engagement practice ranging from the M9 Berretta pistol to 
the MK19 grenade machine gun. Qualification and crew engagement practice are both 
possible with the EST 2000. 

The impetus for the original 2008 study was an ammunition shortage at the 
training bases responsible for conducting initial military training for soldiers. It was 
presumed that the ammunition shortages, caused by engagements in both Iraq and 
Afghanistan, would continue to exist and that alternative approaches to training heavy 
weapons were required. Therefore, the TRADOC commander requested that a study be 
conducted to determine if substituting virtual simulation practice for live fire practice 
would impact soldier proficiency on the M2 and MK19 and to what extent. Two 
objectives and two essential elements of analysis (EEA) were listed in the 2008 TEA for 
the EST. 

• Objective 1. Determine the effect of substituting EST 2000 training for 
M2 .50 caliber live-fire training. 

• Objective 2. Determine the effect of substituting EST 2000 training for 
MK19 40mm live-fire training. 
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• EEA E How does the quality of EST 2000 training differ from live-fire 
training in terms of impact on end-of course weapons’ proficiency with 
the M2 .50 caliber and MK 19 40mm grenade machine guns? 

• EEA 2. Can EST 2000 training effectively substitute for live-fire training 
in terms of its impact on target engagement proficiency with the M2 .50 
caliber and MK 19 40mm grenade machine guns? 

The stated scope of the TEA study was based on live-fire day qualification 
training of both weapons and the focus was on evaluating the quality of EST 2000 
training, not on evaluating the initial-entry training (lET) heavy weapons training 
programs (Hughes & Nau, 2008). 

Review of the objectives, stated EEAs, scope and focus of the TEA led us to 
believe that the study was improperly focused to determine if deliberate practice with the 
EST 2000 could reduce or eliminate the need to conduct deliberate practice using live 
ammunition. The EST 2000 does not train soldiers—rather, it is an ITE that allows for 
the deliberate practice of such skills as the four fundamentals of marksmanship (steady 
position, proper sight picture, proper breathing, and trigger squeeze), target identification, 
range determination, and target engagement with a selected weapon system. With this 
perspective, our evaluation focused on whether or not the EST 2000 ITE contained the 
necessary affordances to facilitate task execution and deliberate practice of the skills 
involved in engaging targets using both the M2 and MK19 weapon systems. 

We began this study with a review of the weapons manuals for the MK19 and M2 
as well as a review of the day qualification shooting standards for both weapons (i.e., DA 
forms 7518-R and 7448-R respectively). We recognized that in this study it was not 
necessary to describe the operational need or to determine and describe the ITE 
capabilities using an operational concept and functional allocation. Since the EST is an 
established ITE whose scope is clear we did not believe these two steps were necessary. 
Eigure 24 depicts the sub-processes of ITEAM used for this study. 
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► Actions within the dashed box- - are 

used for ITE requirements definition. 



► Actions within the dotted box .are 

used for ITE verification. 


► Actions within the solid box - are 

used to assess the ITE. 



Figure 24. ITEAM steps utilized during this evaluation 


This study began by eonducting a task analysis (TA). We started by defining the 
high-level tasks and the preconditions supporting the assessment. Several of the 
preconditions were assumptions about the lET heavy weapons program that were not 
considered in the original TEA and were also beyond the scope of the present assessment. 
We conducted the TA for both weapon systems that included activities we felt necessary 
for the high-level task under investigation. The detailed results of the ITEAM assessment 
of the MK19 and M2 may be found in Appendix G. 

B. DISCUSSION 

The results of the ITEAM assessment predicting the EST 2000’s ability to support 
the deliberate practice of engaging targets with the M2 and MK19 was a 4.00 very good 
and 4.43 very good respectively (Table 7). In their evaluation of the EST, TRAC-WSMR 
found no statistical difference in live fire qualification scores between the two groups 
who solely used the EST to practice target engagement and those who solely used live 
fire practice (Hughes & Nau, 2008). This outcome is consistent with our prediction that 
the ITE supports the deliberate practice and skill acquisition of target engagement very 
well. The results of soldier opinion surveys also support the ITEAM assessment. Soldiers 
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and instructors were asked to rate the quality of their prequalification training as 
excellent, good, adequate, inadequate, poor, and very poor. For the M2, 50 percent of 
respondents rated their pre-qualification EST training preparing them for live fire as good 
and an additional 13 percent rated it as excellent. For the MK19, 36 percent rated their 
EST pre-qualification training as good and 41 percent rated the training as excellent. 
Tables 8 and 9 depict the results of the ITEAM assessment and TEA user surveys of the 
EST 2000. 


Table 7. ITEAM assessment score for EST 2000 HW M2 and MK19 


M2 

MK19 

4.00 Very Good 

4.43 Very Good 


Scale 


S—Excellent: ITE contain.s all but a few (90-100%) of the affordances determined necessary 
4—Very Good: ITE contains a significant portion (70-89%) of the affordances determined necessary 
3—Good: ITE contains a good portion (50-69%) of the affordances determined necessary 
2—Fair: ITE contains some (25-49%) of the affordances determined necessary 
1 — Poor: ITE contains very few (0-24%) of the affordances determined necessary 


Table 8. M2 firer ratings of prequalification training (number and percent responding) 

(from Hughes & Nau, 2008) 


Rating 

Group I Live 
Training 

Group II 
Familiarization 
Fire + EST 

Training 

Group III EST 
Training 

Total 

Respondents 

Number 

Percent 

Number 

Percent 

Number 

Percent 

Excellent 

8 

33 

3 

13 

3 

13 

14 

Good 

5 

33 

12 

52 

12 

50 

29 

Adequate 

8 

21 

4 

17 

6 

25 

18 

Inadequate 

3 

13 

2 

9 

2 

8 

7 

Poor 

0 

0 

1 

4 

1 

4 

2 

Very Poor 

0 

0 

1 

4 

0 

0 

1 

Total 

24 

100 

23 

100 

24 

100 

71 


Note: No statistically significant differences between groups (Chi-Square = .657, df= 2, p>.05) in terms of 
Good or Excellent ratings versus Adequate or below ratings. 
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Table 9. MK19 firer ratings of prequalification training (number and percent responding) 

(from Hughes & Nan, 2008) 


Rating 

Group I Live 
Training 

Group II 
Familiarization 
Fire + EST 

Training 

Group III EST 
Training 

Total 

Respondents 

Number 

Percent 

Number 

Percent 

Number 

Percent 

Excellent 

11 

48 

4 

17 

9 

41 

24 

Good 

10 

43 

9 

38 

8 

36 

27 

Adequate 

2 

9 

7 

29 

4 

18 

13 

Inadequate 

0 

0 

2 

8 

0 

0 

2 

Poor 

0 

0 

2 

8 

1 

5 

3 

Very Poor 

0 

0 

0 

0 

0 

0 

0 

Total 

23 

100 

24 

100 

22 

100 

69 


Note: Statistically significant difference among groups in terms of “Good” or "Excellent" ratings versus 
"Adequate" or below ratings (Chi-square = 7.442, df= 2, p<.01). 


Tables 10 and 11 depict the qualification scores for each of the groups evaluated 
in the original TEA. Using ITEAM, we predicted that the EST 2000 HW M2 and MK19 
would support the performance of the high-level task of target engagement very well. The 
results of the qualification firing assessment and the prediction made using ITEAM are 
consistent with our original hypothesis that an analytical assessment methodology based 
on human abilities and affordance theory can predict task elements within an integrated 
training environment with the highest likelihood of positive training transfer. 


Table 10. M2 Qualification Average Hits (Out of Possible 11 at Eort Sill and 9 at Eort 

Benning (from Hughes & Nau, 2008) 


Location 

Qualiflcation 
Rounds Per 
Firer 

Group I 
Live Training 

Group II 
Familiarization 
Fire + EST 
Training 

Group III ST 
Training 

Total 

Firers 

Number 

Hits 

Number 

Hits 

Number 

Hits 

Fort Sill 

182 

3 

4.67 

3 

7.00 

3 

8.33 

9 

Fort Sill* 

114 

9 

4.56 

8 

4.63 

9 

3.44 

26 

Fort Benning 

140 

12 

6.83 

12 

7.33 

12 

7.08 

36 

Total 


24 

5.71 

23 

6.35 

24 

5.88 

71 


Note: The M2 fires a recommended 5-7 round burst. 
*EST2000 Heavy Weapons TEA 
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Table 11. MK19 qualification average number of hits (out of 10) (from Hughes & Nau, 

2008) 


Location 

Qualification 
Rounds Per 
Firer 

Group I 
Live Training 

Group II 
Familiarization 
Fire + EST 
Training 

Group III ST 
Training 

Total 

Firers 

Number 

Hits 

Number 

Hits 

Number 

Hits 

Fort Sill 

62 

12 

9.62 

12 

8.33 

10.00 

8.00 

34 

Fort Benning 

62 

11 

9.82 

12 

8.33 

12.00 

9.58 

35 

Total 


23 

9.74 

24 

8.33 

8.86 

22.00 

69 


Note: The MK19, which fires a recommended 3-5 round burst, is an area suppression weapon with a 
personnel casualty-producing ra dius of 15 meters from impact. 


ITEAM identified the same shortcomings with the EST 2000 that were noted in 
the TEA by soldiers and their instructors. The shortcomings were the visibility of targets 
and weapons effects, the inability to properly clear both weapons and the inability to 
replicate environmental factors (i.e., heat, cold, wind, rain). None of these factors 
impacted the EST 2000’s ability to support deliberate practice or live fire qualification. 
Additional comments made by instructors and firers captured in the original TEA tended 
to deal with shortcomings in the weapons training program and not the EST 2000 itself. 
One such comment dealt with the importance of hands-on, non-firing training to assist 
with soldier proficiency in using the weapons in combat (Hughes & Nau, 2008). Our 
ITEAM assessment did not examine the initial-entry training (lET) weapons training 
program. 

C. CONCLUSIONS 

Comparing the results of the survey data from the EST 2000 TEA and the ITEAM 
assessment reinforces our claim that a process using affordances as a way to predict ITE 
utility is effective. Using ITE affordances based on human abilities and specific tasks 
provides a reasonably reliable way of predicting ITE support to training. Evaluation of 
the EST 2000 using ITEAM further demonstrates that the structured analytical 
methodology and processes incorporated within ITEAM are reliable and may be used 
effectively to assess and determine ITE utility. 
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VII. DISCUSSION 


This dissertation began with an introduction to the culture of Army training and 
highlighted a situation where the efficacy of training may be questionable based on the 
knowledge of those called upon to lead and conduct a unit’s training program. We then 
conducted an investigation of the literature dealing with training. This review highlighted 
many but not all of the pieces of the training puzzle. We learned about how the initial 
piece of the Joint Capabilities Integration Development System (JCIDS) works and how, 
over time, the system has become less effective in the support of ITE development. There 
was a great deal of discussion about front-end analysis and its impact on ITE 
development and success. The discussion highlighted the importance of task analysis and 
that the development of training objectives is rarely done. The positive and negative 
influence of SMEs on ITE development, with respect to fidelity and bias were discussed 
and, while controversial, it was recognized that SMEs have a very important role to play 
in the training puzzle. We spent considerable time discussing transfer of training (TOT). 
TOT is recognized by many as the ultimate way to determine effectiveness of ITEs. We 
highlighted the inherent difficulties and flaws in relying solely on TOT as the means for 
determining ITE effectiveness. 

Erom the outset of this research, we recognized that any analytical assessment of 
an integrated training environment (ITE), however effective it may be, would never lead 
to crisp results about transfer of training (TOT) like a well-developed and executed 
empirical TOT study. Conversely, there was also recognition that empirical evaluation of 
ITEs is not being conducted for many reasons including cost and difficulty in obtaining 
informative data. Eastly, we learned that even when empirical TOT studies are 
performed, they might not be what they appear to be. In many cases, inferences about 
transfer are made based on data that is not grounded in performance. We suggest that this 
is minimally useful at best and misleading at worst. We surmise that both of these reasons 
directly relate to why the empirical evaluations that are being conducted result in weak or 
inconclusive results. 
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The literature review drew to a close beginning with a discussion on the various 
ways simulations have been analytically evaluated inside and outside of the training 
domain. The review was informative as it showed that the state of the art in analytical 
assessment is not all that good. Review of the training simulation assessment literature 
assisted us in shaping our methodology and in avoiding common pitfalls. 

We concluded the literature review by discussing the USA training effectiveness 
analysis (TEA) system. This system formerly provided the policy and regulation over 
TEA studies conducted to determine the cost and effectiveness of training programs and 
ITEs. The discussion pointed out one very important item that was repeatedly seen 
throughout this research. The TEA system did not prescribe how TEAs should be 
conducted, nor did it constrain analyst’s methods for reaching their conclusions. Carter 
(1982) made the point that the lack of detailed guidance on how to conduct a TEA was a 
threat to the accuracy of the results. Simpson (1995) refuted this idea indicating that 
providing a cookbook to do TEAs would result in skepticism of the results by anyone 
outside of the DOD. Based on our experience with the several TEAs used for this 
research and others that were reviewed but not included, we would strongly argue in 
support of Carter’s position. The lack of specific guidance was recognized as a failure of 
the system in several of the TEAs we analyzed. While the use of appropriate statistical 
methods were always employed, it was rare to see appropriate data used in support of the 
conclusions drawn from the statistical methods. The lack of prescriptive guidance to 
include investigation of the actual ITE has resulted in a wide spread of techniques used to 
justify ITE effectiveness most often divorced from the actual ITE under investigation. 
We are discouraged by the elimination of the TEA system, but we are even more 
discouraged by what we have seen produced and labeled as TEA studies used to support 
decision making in the material acquisition process (MAP). 

We set out with an objective to investigate the current state of the art of analytical 
assessment of TTEs with the belief that there had to be a way to determine ITE utility that 
fell somewhere on the analysis spectrum between doing nothing and useful empirical 
evaluation. Eurthermore, we believed that an analytical solution based on human abilities 
and affordance theory instead of just technology would provide a solid foundation to 
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start. We developed ITEAM based on the information and lessons learned from the 
literature and a systematic approach to problem solving taught within the systems 
engineering discipline. Several lessons were learned during this process about ITEAM 
and its application. Eirst and foremost, domain experience is necessary in order to use 
ITEAM effectively. A lack of domain experience or knowledge can result in a situation 
where the results of an analysis falsely indicate a situation that an TTE fully supports 
training when it does not. Without domain knowledge and experience, an essential 
understanding of the necessary ITE affordances does not exist and cannot be determined 
appropriately. 

The consistent application of ITEAM mitigates the effects of evaluator bias. 
During the assessments of ESC and VBS2, we recognized instances where our own bias 
interfered with our assessment of the ITE in question. With ESC, we recognized that in at 
least one instance we treated two similar affordances in two different analyses 
inconsistently. This resulted in an inflated rating for one of the analyses and a conflict. 
Taking the time to draft a study plan, rules for ITE examination and the handling of 
unique and similar situations reduces the level of SME subjectivity (bias) involved in 
using ITEAM. During our evaluation of VBS2, we again recognized our bias, this time 
against a game’s ability to provide a useful practice environment for physical tasks. 
Recognizing that this situation occurred while using a logical process provided us insight 
into how evaluator bias impacts assessment when a methodology like ITEAM is not used. 
We believe that bias is but one of several “elephants in the room” during TEA. 

ITEAM development was grounded in the logic of systems engineering and 
human abilities, which have demonstrated evolutionary stability for over 40 years. 
Through the use of this methodical process we re-examined three TEA studies that 
included games and virtual training simulators. In each study, ITEAM demonstrated a 
level of success in predicting the utility of the ITE to support the deliberate practice of 
tasks. While we are not going to reiterate the analysis done within each study, we will 
reiterate that based on the results of these studies we are confident asserting that the 
application of an analytical methodology to evaluate ITE utility in support of the 
deliberate practice of skills is useful. 
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The debate over the value of analytical assessment of TTEs will continue but we 
believe that our efforts have shed light on a new way to approach the issue. Implementing 
a methodical process in assessment efforts forces an accounting of things that the current 
acquisition process ignores or bypasses. Each process and sub-process of ITEAM unlocks 
information about the stakeholder’s needs and ITE requirements that otherwise might be 
missed if the methodology was not followed. Eurthermore, given that the cost of using 
the methodology is so small, it will result in cost savings of time and money in the areas 
of design, development and manufacturing of ITEs. 

We suggest that a similar situation exists today as was seen in graphical user 
interface (GUI) design a decade ago. A great deal of effort at that time was placed on the 
research and development of how to make better GUIs. Much of this work was empirical 
in nature. Techniques were proposed, interfaces were designed and developed, and then 
they were tested with real users. That work resulted in methodologies and standards that 
guide GUI design and development today. Where user testing was the norm a decade ago, 
today it is used in a very focused fashion and sparingly. Much of the time, good 
interfaces are developed using guidelines that emerged from empirical research without 
conducting empirical user tests. This result is due to the recognition that when proven and 
stable methodologies are used during development, good GUIs will result. We want this 
result for training systems. Based on that model, we suggest that the acquisition 
community include ITEAM in their existing design, development and testing processes to 
establish and refine it. In doing so over time, the need for empirical testing of ITEs may 
be better scoped, reduced and possibly eliminated. 
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VIII. 


CONCLUSIONS AND FUTURE WORK 


A. CONCLUSIONS 

Based on the TEAs we have reviewed and re-analyzed, it is apparent that the issue 
of candor described in Paolozzi (2013) also effects ITE effectiveness analysis. Use of 
broad declarations within formal studies to validate ITEs is fueled by several desires. The 
stakeholder’s desire is that the ETE positively support the desired training necessary to 
prepare soldiers for waging war. The acquisition community’s desire is to demonstrate 
that the management of the ITE program was responsible and correct. Both desire a 
positive outcome so as to avoid being the bearer of bad news to Congress or USA 
leadership that the return on investment for the ITE is indeterminable or worse, negative. 
This desire is perhaps the strongest of them all. Millions of dollars are spent annually on 
ITEs in the military acquisition process (MAP). Thousands more are spent to justify that 
millions were not wasted. In many cases studies carefully designed to answer questions 
about utility fail to examine the ITEs in question. The studies ask the wrong questions 
and use data obtained from non-relevant areas to support hypotheses of system utility. 
Aside from providing a shield to block criticism or a crutch to steady the doubtful, these 
studies do very little to help us know what our ITEs actually support. 

Implementation and use of ITEAM throughout the system lifecycle prevents a 
situation where after the fact TEAs provide a negative outcome that is unpalatable. Using 
ITEAM provides developers and decision makers with windows of opportunity to make 
decisions impacting ITE design and development, before serious money has been 
committed. 

The Army needs to reinvigorate the TEA system by adopting a methodology for 
evaluating ITEs and training programs. Elimination of the TEA system in the face of 
budget pressures has created a policy void and lack of guidance and experience for 
determining ITE utility. Millions of dollars have been spent in efforts to design, develop 
and field TTEs that allow military forces to maintain established proficiencies and gain 
new ones. Without policy to guide assessment efforts, millions of dollars may be wasted. 
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The calls for proof that ITEs are worth the money being spent on them are 
increasing (GAO, 2013). The training domain’s ability to develop and apply specific 
measures of performance (MOP) and effectiveness (MOE) to the study of human 
performance has improved over the past several decades. Unfortunately, practical 
application of MOP and MOE remain inadequate for the task of determining ITE utility. 
Reliance on subject matter experts (SMEs) to provide insight into TTE utility remains 
constant. Suggestions to eliminate the use of SMEs are as ignorant as expecting any 
single SME to provide all of the answers to questions about ITE utility. 

The results of this research have revealed several things. Eirst and foremost is that 
an analytical assessment methodology based on human abilities and affordance theory 
can be used to predict task elements where training transfer is most likely to be found. 
Second, domain subject matter expertise is necessary when conducting an evaluation of 
an ITE but that expertise is only useful when it is focused appropriately rather than 
broadly. SME bias and overconfidence exists. Continued evaluation of ITE utility 
without the use of some form of logical normalizing “hand rail” like ITEAM will result 
in the status quo. Providing domain experts with a tool like ITEAM that allows them to 
move away from a single question of “how good is the ITE,” towards guided analysis is 
what is being suggested. The use of ITEAM provides SMEs with a tool to parse an ITE to 
an atomic level where they may apply their expertise appropriately. Specific questions of 
ITE utility that an SME has direct experience with may be answered with ease. The 
challenge is to place SMEs in positions where their expertise may be applied responsibly, 
where they are asked questions that they are best qualified to answer, and to provide them 
with a tool that allows them to dissect an ITE into reasonable pieces so that they may 
apply their knowledge and experience appropriately. 

Since ITEAM does not attempt to determine appropriate levels of fidelity for 
system affordances, it cannot be relied upon to answer questions about the quality of the 
affordances in the ITE. ITEAM only provides insight as to whether or not specific 
affordances are available. With that information, a generalized rating of ITE support for 
training is provided. This research approached all affordances as being equal. Reality 
demonstrates that some things are more important than others, so a way of factoring that 
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into the evaluation and scoring process of the methodology is necessary. Finally, the 
current way we go about assessment using vague or broadly scoped questions is not 
useful. Decision makers and analysts alike must be more diligent in formulating the 
specific questions that they require answers for. Taking time early to conduct thorough 
front-end analysis is not time wasted. Rather it results in a time savings and prevents all 
of us from having to redo analysis that is inconclusive. 

B. FUTURE WORK 

Initial enhancement work is needed in the scoring area of ITEAM to account for 
and provide emphasis on those items that are deemed “critical” ITE affordances. One 
suggestion is the integration of value modeling and the application of weighting to both 
affordances and tasks. We believe that enhancing ITEAM in this way will better align it 
with the current reality that recognizes all things are not held equally. Some tasks and 
some affordances are simply more important to a stakeholder than others. As it stands, 
ITEAM treats all tasks and affordances equally. This was necessary considering that 
there were no obvious attempts to weight tasks or ITE characteristics in the studies 
reexamined using ITEAM. 

As with every new development, more testing is always desirable. As described, 
ITEAM has the capability to assist in the requirements definition, verification and 
assessment phases of the material acquisition process (MAP). Documented 
implementation of ITEAM in a new or ongoing acquisition program and/or the 
application of ITEAM to other previously evaluated systems would help to solidify the 
approach and help in discovering any serious shortcomings that may have been missed 
during this initial research effort. 

This dissertation focused on the development of a methodology that can be used 
to determine ITE utility to support the deliberate practice of specific tasks. We 
demonstrated the reliability and consistency of the process using three distinct case 
studies employing three different ITEs. We did not attempt to investigate or measure the 
inter-rater reliability (IRR) of using the methodology due to time constraints and the 
belief that consistency and reliability should come first. A recommendation for future 
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work is to establish IRR using ITEAM. We believe that doing so is a logical next step to 
continue the work started here. 

Ease of use and implementation difficulty are two reasons why analytical 
assessment methodologies are discounted or discarded. A suggestion for future work is to 
automate the ITEAM process. The potential trap with automation is that by automating 
the processes, the methodology becomes too difficult for the layman to use. Care should 
be taken to ensure that the integrity of the form of the process does not fall prey to the 
automation of the function of the process. At a minimum, automation of the scoring 
procedure for the methodology would be a significant help to those who may implement 
this technique in large ITE projects. 

Upon reading an ITTSEC best paper in 2013 on aural visual data (Napoletano, 
2013), it became evident to us that including this type of capability into ITEAM would be 
very powerful. Often, sound provides insight into a situation. Rotary aviators commonly 
speak about determining aircraft problems based on the sounds in the cockpit. Within 
ITEAM sound may be accounted for but determining the appropriate quality is currently 
impossible. Work done by Napoletano (2013) could change that limitation and provide an 
opportunity to integrate affordance quality into the discussion of TTE utility and ITEAM. 

After three years of investigating and working with human abilities, it occurred to 
us that there is no human ability representation for smell or taste. Several cognitive 
abilities could possibly be used to explain smell and taste but we believe that given the 
number of occupations that rely on smell and taste, these two abilities should be 
investigated as described by Eleishman and Quaintance (1984) and added to the 
taxonomy of 52 human abilities. 

Einally, we recommend that the Army reconsider the decision to eliminate the 
TEA system. We recommend that a review of the organization and system take place 
with a goal of implementing a better process. The TEA system provided structure to the 
conduct of training effectiveness analysis studies. It lacked prescriptive guidance on the 
proper approach to ITE assessment. Elimination of redundant analytical bureaucracy (the 
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division of TRAC-WSMR that oversaw the TEA system) may make sense, but standards, 
structure and guidance for ITE assessment are still required. 
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APPENDIX A. HUMAN ABILITIES 


Human Abilities List 

*From Ability Measurement in DOL's Occupational Information Network (0*NET) A Factorial Approach by Edward J. Hester and VYTO Baltrukenas 




Grouping* 

Ability 

Ability Description 

Cognitive-Verbal 

Oral Expression 

The ability to communicate information and ideas in speaking so others will 
understand. 

Cognitive-Verbal 

Oral Comprehension 

The ability to listen to and understand information and ideas presented through 
spoken words and sentences. 

Cognitive-Verbal 

Written 

Comprehension 

The ability to read and understand information and ideas presented in writing. 

Cognitive-Verbal 

Written Expression 

The ability to communicate information and ideas in writing so others will 
understand. 

Cognitive -Idea Generation and 
Reasoning 

Deductive Reasoning 

The ability to apply general rules to specific problems to produce answers that make 

sense. 

Cognitive -Idea Generation and 
Reasoning 

Fluency of Ideas 

The ability to come up with a number of ideas about a topic (the number of ideas is 
important, not their quality, correctness, or creativity). 

Cognitive -Idea Generation and 
Reasoning 

Inductive Reasoning 

The ability to combine pieces of information to form general rules or conclusions 
(includes finding a relationship among seemingly unrelated events). 
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Cognitive -Idea Generation and 
Reasoning 

Qriginality 

The ability to come up with unusual or clever ideas about a given topic or situation, or 
to develop creative ways to solve a problem. 

Cognitive -Idea Generation and 
Reasoning 

Problem Sensitivity 

The ability to tell when something is wrong or is likely to go wrong. It does not involve 
solving the problem, only recognizing there is a problem. 

Cognitive -Idea Generation and 
Reasoning 

Information 

Qrdering 

The ability to arrange things or actions in a certain order or pattern according to a 
specific rule or set of rules (e.g., patterns of numbers, letters, words, pictures, 
mathematical operations). 

Cognitive -Idea Generation and 
Reasoning 

Category Flexibility 

The ability to generate or use different sets of rules for combining or grouping things 
in different ways. 

Cognitive-Quantitative 

Mathematical 

Reasoning 

The ability to choose the right mathematical methods or formulas to solve a problem. 

Cognitive-Quantitative 

Number Facility 

The ability to add, subtract, multiply, or divide quickly and correctly. 

Cognitive-Spatial 

Visualization 

The ability to imagine how something will look after it is moved around or when its 
parts are moved or rearranged. 

Cognitive-Spatial 

Spatial Qrientation 

The ability to know your location in relation to the environment or to know where 
other objects are in relation to you. 

Cognitive-Perceptual 

Flexibility of Closure 

The ability to identify or detect a known pattern (a figure, object, word, or sound) 
that is hidden in other distracting material. 
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Cognitive-Perceptual 

Speed of Closure 

The ability to quickly make sense of, combine, and organize information into 
meaningful patterns. 

Cognitive-Perceptual 

Perceptual Speed 

The ability to quickly and accurately compare similarities and differences among sets 
of letters, numbers, objects, pictures, or patterns. The things to be compared may be 
presented at the same time or one after the other. This ability also includes 
comparing a presented object with a remembered object. 

Cognitive-Memory 

Memorization 

The ability to remember information such as words, numbers, pictures, and 
procedures. 

Cognitive-Attentiveness 

Selective Attention 

The ability to concentrate on a task over a period of time without being distracted. 

Cognitive-Attentiveness 

Time Sharing 

The ability to shift back and forth between two or more activities or sources of 
information (such as speech, sounds, touch, or other sources). 




Sensory-Visual 

Night Vision 

The ability to see under low light conditions. 

Sensory-Visual 

Peripheral Vision 

The ability to see objects or movement of objects to one's side when the eyes are 
looking ahead. 

Sensory-Visual 

Glare Sensitivity 

The ability to see objects in the presence of glare or bright lighting. 

Sensory-Visual 

Depth Perception 

The ability to judge which of several objects is closer or farther away from you, or to 
judge the distance between you and an object. 
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Sensory-Visual 

Far Vision 

The ability to see details at a distance. 

Sensory-Visual 

Near Vision 

The ability to see details at close range (within a few feet of the observer). 

Sensory-Visual 

Visual Color 

Discrimination 

The ability to match or detect differences between colors, including shades of color 
and brightness. 

Sensory-Auditory and Speech 

Auditory Attention 

The ability to focus on a single source of sound in the presence of other distracting 
sounds. 

Sensory-Auditory and Speech 

Speech Clarity 

The ability to speak clearly so others can understand you. 

Sensory-Auditory and Speech 

Speech Recognition 

The ability to identify and understand the speech of another person. 

Sensory-Auditory and Speech 

Flearing Sensitivity 

The ability to detect or tell the differences between sounds that vary in pitch and 
loudness. 

Sensory-Auditory and Speech 

Sound Localization 

The ability to tell the direction from which a sound originated. 




Psychomotor-Fine Manipulative 

Arm-Fland 

Steadiness 

The ability to keep your hand and arm steady while moving your arm or while holding 
your arm and hand in one position. 
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Psychomotor-Fine Manipulative 

Manual Dexterity 

The ability to quickly move your hand, your hand together with your arm, or your two 
hands to grasp, manipulate, or assemble objects. 

Psychomotor-Fine Manipulative 

Finger Dexterity 

The ability to make precisely coordinated movements of the fingers of one or both 
hands to grasp, manipulate, or assemble very small objects. 

Psychomotor-Control Movement 

Control Precision 

The ability to quickly and repeatedly adjust the controls of a machine or a vehicle to 
exact positions. 

Psychomotor-Control Movement 

Response 

Orientation 

The ability to choose quickly between two or more movements in response to two or 
more different signals (lights, sounds, pictures). It includes the speed with which the 
correct response is started with the hand, foot, or other body part. 

Psychomotor-Control Movement 

Rate Control 

The ability to time your movements or the movement of a piece of equipment in 
anticipation of changes in the speed and/or direction of a moving object or scene. 

Psychomotor-Control Movement 

Multilimb 

Coordination 

The ability to coordinate two or more limbs (for example, two arms, two legs, or one 
leg and one arm) while sitting, standing, or lying down. It does not involve performing 
the activities while the whole body is in motion. 

Psychomotor-Reaction Time and 
Speed 

Wrist-Finger Speed 

The ability to make fast, simple, repeated movements of the fingers, hands, and 
wrists. 

Psychomotor-Reaction Time and 
Speed 

Reaction Time 

The ability to quickly respond (with the hand, finger, or foot) to a signal (sound, light, 
picture) when it appears. 

Psychomotor-Reaction Time and 
Speed 

Speed of Limb 
Movement 

The ability to quickly move the arms and legs. 
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Physical-Strength 

Static Strength 

The ability to exert maximum muscle force to lift, push, pull, or carry objects. 

Physical-Strength 

Explosive Strength 

The ability to use short bursts of muscle force to propel oneself (as in jumping or 
sprinting), or to throw an object. 

Physical-Strength 

Dynamic Strength 

The ability to exert muscle force repeatedly or continuously over time. This involves 
muscular endurance and resistance to muscle fatigue. 

Physical-Strength 

Trunk Strength 

The ability to use your abdominal and lower back muscles to support part of the body 
repeatedly or continuously over time without 'giving out' or fatiguing. 

Physical-Stamina 

Stamina 

The ability to exert yourself physically over long periods of time without getting 
winded or out of breath. 

Physical-Flexibility, Balance and 
Coordination 

Extent Flexibility 

The ability to bend, stretch, twist, or reach with your body, arms, and/or legs. 

Physical-Flexibility, Balance and 
Coordination 

Dynamic Flexibility 

The ability to quickly and repeatedly bend, stretch, twist, or reach out with your 
body, arms, and/or legs. 

Physical-Flexibility, Balance and 
Coordination 

Gross Body 
Coordination 

The ability to coordinate the movement of your arms, legs, and torso together when 
the whole body is in motion. 

Physical-Flexibility, Balance and 
Coordination 

Gross Body 

Equilibrium 

The ability to keep or regain your body balance or stay upright when in an unstable 
position. 
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APPENDIX B. EXAMPLE QUESTIONS USED DURING ITEAM 

APPLICATION 


The following questions are the kind asked during each of the sub-phases of each of the 
main processes of ITEAM. This list is not exhaustive. 

A. REQUIREMENTS DEFINITION 

1. Definition of the Need 

• What is the problem or capability gap? 

• Is this a training system problem? Is an ITE the answer to the problem? 

• Can our existing ITEs address this or what is missing in our current ITE 
solutions? 

• Can we define successful execution in measurable ways? 

• What does success look like in terms of the need? 

2. Operational Concept/Functional Allocation 

• Where does this “thing” fit into our existing training program(s)? 

• What stage of training are we in (crawl, walk, run)? 

• Do we need a part task device or a whole environment? What’s the vision? 

• What do we want trainees to do with/in the TTE? 

• What are our expectations of trainee performance? How will we measure? 

• What is the setting where this ITE will be used (classroom, field)? 

• What aspects of the problem (need) do we want to offload to the ITE? 

• What aspects of the ITE drive trainee response? 

• What kinds of responses/actions do we want trainees to practice? 

3. Task Analysis/Learning Objectives 

• What are our desired training/learning outcomes? 

• What tasks can be derived from our training objectives? 

• Which tasks are the most critical? 

• Which tasks do we want the ITE to support the practice and execution of? 

• What is the best approach for us to use to describe tasks and their 

execution? 
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• Does the level of task description allow us to easily identify the human 
abilities involved in the execution of the task? 

• Are the tasks broken down to a level where we can describe the necessary 
characteristics of the environment (affordances)? 

4. Real World Human Ability Inventory 

• Is this task cognitive, physical, sensory or psychomotor in nature? 

• What abilities do we think are involved with this task? 

• What kind of activity is involved with this task/mission? 

• In what kind of situations might this task be executed? 

• What are the most important human abilities involved with the practice of 

the tasks? 

5. Real World Affordance Requirements 

• What do we have to have in the environment in order to stimulate the 
human abilities listed for the task? 

• Have we described the affordances appropriately? Does our description 
point to a solution or a specification for a solution? 

• Have we described the affordances in a quantifiable manner? 

• Where does the activity occur? (i.e., what kind of natural environment or 
weather conditions). 

• Is the natural environment important to the practice of the task? 

• Is equipment involved? 

• Does equipment have to be in the ITE in order for the practice of the tasks 
to occur? 

• Do affordances have to be high fidelity for the practice of the tasks? 

B. VERIFICATION OF ENVIRONMENT 

I. Determine ITE HA 

• What human abilities does this ITE support? 

• How does a trainee perform the task in the ITE? 

• Are the required abilities supported? 

• What non-essential abilities are supported? 
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• What does the ITE HA supported list tell us about how we should use the 
ITE? 

• Do the non-essential HA’s support other aspects of our training program 
that are important? 

• Can we leverage the ITE for reasons not originally planned? 

2. Determine ITE Affordance Resources 

• What does the ETE contain? 

• What are the characteristics of the ITE? 

• At a minimum, does the ITE have affordances we believe are required? 

• What non-essential affordances exist? 

• Can non-essential affordances be useful in supporting other aspects of our 
training program? 

• Do non-essential affordances negatively impact practice? 

• Is the fidelity level of the affordances acceptable to support practice? 

C. ASSESSMENT 

• Does the ITE contain the necessary affordance resources? 

• Do we have a plan for treating the same or similar affordances equally? 

• Do we have a plan for reconciling conflicts due to our bias? 

• Do we recognize the HA supported by the ITE and what that means in 

terms of the types of practice that can be supported? 

• Have we listed the affordances in a manner where they may be quantified? 

• Do we understand the scoring process? 

• Do we have a plan for how we will document the process so that we may 
accomplish the scoring and evaluation? 
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APPENDIX C. CONCEPT OF OPERATION USED DURING VBS2 

TRAINING AT FORT HOOD 


The following slide depicts a basic mission concept that was used for unit training 
at Fort Hood, Texas during the time of the game-based training effectiveness TEA. This 
concept of operations (CONOP) was provided to units who were then allowed to modify 
it based on their own training objectives. 
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BAGHDAD - SECURITY OPERATIONS 


SITUATION: 

Terrain: 

Varied terrain transitioning from 
rolling high desert to lush green 
zone just north of the city 
Baghdad. 

Friendly: 

CF units are located at FOB 
THUNDER . No other units are 
expected in sector. Minimal 
ANP units are in sector at 
various checkpoints. 

Enemy: 

Elements of the Baathist and 
Shiite Militia are attempting to 
disrupt CF operations in 
Baghdad province. Recent 
reports indicate 5-10 man 
elements armed with AKs, RPKs, 
and RPGs emplacing lEDs with 
over watch positions capable of 
ambushing if a unit is stalled by 
an lEO. 



EXECUTION: 

Maneuver: 

Use movement techniques appropriate with the threat level. 
Fires: 

Indirect fires are prohibited from use in urban areas. 

Coordinating Instructions: 

Conduct rehearsals prior to SP. 

Report all Checkpoints. 

Report halts and other incidents. 

The enemy must be positively identified prior to engagement. 
Take necessary measures to preserve civilian lives. 


SERVICE AND SUPPORT: 


CASEVAC: 

lAW Unit SOP 

Vehicle Recovery: 
lAW Unit SOP 


COMMAND AND SIGNAL; 

Succession of Command: lAW Unit SOP 

EOD call sign; "Sapper " 

Air MEDEVAC call sign; "Dust Oft" 

Ground MEDEVAC call sign: "Evac 16" 

QRF call sign: "Gunslinger 44" 

CAS call sign; "Outlaw 16" 



Time 

Event 


Receive Mission 


Issue Warning Order 


Make a Tentative Plan 


PCC/PCI 


Recon/TiGR Uodate 


Issue Order 


Back Briefs 


SP Reoort 


EOM AAR 


RP Destination 


AAR 


TiGR Uodate 






MISSION: 

Conducts area security operations vicinity Baghdad lOT disrupt 
insurgent movement in Baghdad province. 


COMMANDER'S INTENT: 

Purpose: 

Disrupt the flow of enemy forces in and around Baghdad to allow time 
for the IP to establish a presence. 

Key Tasks: 

•Safe conduct of all movements 
-Decisive action against any enemy forces 

•Ensure proper PID and the use of EOF with consideration toward the 
local populace 

End state: 

Unit manned at 100% strength, insurgents operating in the area 
destroyed, and Baghdad secured by IP. 


RISK ASSESSMENT: 

Your unit assumes risk by operating in a new area of Baghdad province 
without a RIP. 


CONCEPT OF THE OPERATION: 
Task; Move to and stage at RP 
PIR: 

-Enemy contact 
•Mines encountered 

-IP checkpoint: grid, number of IP manning 
FFIR: 

-Loss of any sensitive item 
-Any vehicle becomes NMC 
-Injury to any soldier 
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APPENDIX D. ANALYSIS OF VBS2 


The following pages contain the assessment worksheets from the ITEAM analysis 
of VBS2 in support of this research effort. 


SCORE: 5.00 Excellent 

High Level Task: React to Attack (Near or Far) 

Doctrine: STP 21-1 SMCT (Task 071-COM-3001 React to Direct Fire While Mounted), 
Training and Evaluation Outline for Task 07-3-9013 Conduct action on contact 

Preconditions: Soldiers are familiar with the individual and collective react to attack 
(contact) battle drills for various types of threats (e.g., missile, indirect fire, direct fire, 
lED). 

Tasks: 

1. Elements caught in the kill zone, return fire and use smoke to conceal their movement 
and maneuver to assault through the ambush. 

2. Elements not caught in the kill zone, provide “well aimed” suppressive fire on enemy 
from a support by fire position. 

3. Element leader coordinates/adjusts indirect fire/close air support for elements in the 
kill zone. 

4. Support by fire elements lift and shift their suppressive fire as the elements in the kill 
zone assault through the enemy positions to destroy them. 

5. Eeader reports actions to the CoC. 


Post-conditions: Attack is defeated. Area secured command informed. Casualties 
assessed and immediate buddy aid performed. 


DEFINITION OF SCALE 

5-Excellent - the TTE contains all but a few (90-100%) of the affordances determined 
during the analysis 

4-Very Good - the ITE contains a significant portion (70-89%) of the affordances 
determined during the analysis 
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3-Good - the ITE contains a good portion (50-69%) of the affordances determined 
during the analysis 

2-Fair - the ITE contains some (25-49%) of the affordances determined during the 
analysis 

1-Poor - the ITE contains very few (0-24%) of the affordances determined during the 
analysis 
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Real World (RW) Preconditions: Soldiers are familiar with the individual 
and collective react to attack (contact) battle drills for various types of threats 
(e.g., missile, indirect fire, direct fire, lED). 

Environmental Evaluation 

Pocus included both mounted and dismounted operations for this task. 

RW Tasks 

RW Human Abilities 

RW Affordance 
Requirements 

Environment HA 

Environmental 

Affordances 

Level of Support to 
Training 

Elements caught in the 
kill zone, return fire 
and use smoke to 
conceal their movement 
and maneuver to assault 
through the ambush. 

COGNITIVE: 

Oral Expression; Oral; 
Comprehension; 
Originality; Problem 
Sensitivity; Information 
Ordering; 

Visualization; Spatial 
Orientation; Elexibility 
of Closure; Speed of 
Closure; Perceptual 
Speed; Time Sharing; 

SENSORY: 

Night Vision; 

Peripheral Vision; 

Glare Sensitivity; 

Depth Perception; Par 
Vision; Near Vision; 
Visual Color 
Discrimination; 

Auditory Attention; 
Speech Clarity; Speech 
Recognition; Hearing 
Sensitivity; Sound 
Localization; 

PSYCHOMOTOR: 

Arm-Hand Steadiness; 
Manual Dexterity; 

Linger Dexterity; 

Control Precision; 
Response Orientation; 

- Enemy forces 

- Enemy Direct/Indirect 
fire 

- Urban or Suburban 
environment 
containing areas from 
which to conduct an 
ambush and respond 
to an ambush 
containing natural and 
manmade elements. 

- Weather effects (i.e., 
heat, rain, dust, cold) 

- Personal protective 
equipment and 
weapons (i.e., helmet, 
IBAS, LBE, M4) 

- Ammunition (personal 
weapon and crew 
served) 

- Crew served weapons 

- Appropriate military 
vehicles with mounted 
crew served weapons 

- Chain of Command 

- Smoke grenades 
(various colors) or 
vehicle smoke 
generating system 

- PM/Digital 
Communication 

COGNITIVE: 

Oral Expression; Oral 
Comprehension;; 

Problem Sensitivity; 
Information Ordering; 
Spatial Orientation; 
Elexibility of Closure; 
Speed of Closure; 
Perceptual Speed; 
Memorization; Time 
Sharing; 

SENSORY: 

Near Vision; Visual 
Color Discrimination; 
Speech Clarity; Speech 
Recognition; Hearing 
Sensitivity; 

PSYCHOMOTOR: 

Manual Dexterity; 
Response Orientation; 
Multilimb 

Coordination; Reaction 
Time 

PHYSICAL: 

None 

- Affordances Present 

*5 - Excellent 

4 - Very Good 

3 - Good 

2 - Pair 

1 - Poor 
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Rate Control; 

Multilimb 

Coordination; Reaction 
Time; Speed of Limb 
Movement; 

PHYSICAL: 

Static Strength; 

Explosive Strength 
Dynamic Strength; 

Trunk Strength; 

Stamina; Extent 
Elexibility; Gross Body 
Coordination; Gross 
Body Equilibrium 

equipment 

(redundant) 

- Communications link 
with other elements of 
unit/leader 

- Night vision 
devices/optics 

- Stereo sound of 
gunfire, indirect fire, 
other types of 
explosives 

- Muzzle flashes 

- Priendly forces 

- Weapon projectile 
effects 




Elements not caught in 
the kill zone, provide 
‘well aimed’ 
suppressive fire on 
enemy from a support 
by fire position. 

COGNITIVE: 

Oral Expression; Oral 
Comprehension; 
Deductive Reasoning; 
Inductive Reasoning; 
Problem Sensitivity; 
Visualization; Spatial 
Orientation; Elexibility 
of Closure; Speed of 
Closure; Perceptual 
Speed; Time Sharing; 

SENSORY: 

Night Vision; 

Peripheral Vision; 

Glare Sensitivity; 

Depth Perception; Par 
Vision; Near Vision; 
Visual Color 
Discrimination; 

Auditory Attention; 
Speech Clarity; Speech 

- Support by fire 
element 

- Support by fire 
location 

- Urban or Suburban 
environment 
containing areas from 
which to conduct an 
ambush and respond 
to an ambush 
containing natural and 
manmade elements. 

- Weather effects (i.e., 
heat, rain, dust, cold) 

- Crew served and 
personal weapons 

- Priendly force 

- Smoke grenades 
(various colors) or 
vehicle smoke 

- Ammunition 

COGNITIVE: 

Oral Expression; Oral 
Comprehension;; 

Problem Sensitivity; 
Information Ordering; 
Spatial Orientation; 
Elexibility of Closure; 
Speed of Closure; 
Perceptual Speed; 
Memorization; Time 
Sharing; 

SENSORY: 

Near Vision; Visual 
Color Discrimination; 
Speech Clarity; Speech 
Recognition; Hearing 
Sensitivity; 

PSYCHOMOTOR: 

Manual Dexterity; 
Response Orientation; 

- Affordances present 

*5 - Excellent 

4 - Very Good 

3 - Good 

2 - Pair 

1 - Poor 
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Recognition; Hearing 
Sensitivity; Sound 
Localization; 

PSYCHOMOTOR: 

Arm-Hand Steadiness; 
Manual Dexterity; 

Finger Dexterity; 

Control Precision; 
Response Orientation; 
Rate Control; 

Multilimb 

Coordination; Reaction 
Time; Speed of Limb 
Movement; 

PHYSICAL: 

Static Strength; 

Explosive Strength 
Dynamic Strength; 

Trunk Strength; 

Stamina; Extent 
Flexibility; Gross Body 
Coordination; Gross 

Body Equilibrium 

- Distance/Direction to 
orient fires on 

- Indirect fire if 
available 

- CAS if available 

- Military Vehicles with 
crew served weapons 
mounted 

- FM/Digital 
Communication 
equipment 
(redundant) 

- Communication link 
with other elements of 
unit/leader 

- Night vision devices, 
crew served and/or 
personal weapons 
optics 

- Weapon projectile 
effects 

Multilimb 

Coordination; Reaction 
Time 

PHYSICAL: 

None 



Element leader 
coordinates/adjusts 
indirect fire/close air 
support for elements in 
the kill zone. 

COGNITIVE: 

Oral Expression; Oral 
Comprehension; 
Deductive Reasoning; 
Inductive Reasoning; 
Problem Sensitivity; 
Information Ordering; 
Visualization; Spatial 
Orientation; Flexibility 
of Closure; Speed of 
Closure; Perceptual 
Speed; Memorization; 

- Chain of command 

- FM/Digital 
communication 
equipment 

- Communications link 
to elements in contact 
and higher HQ 

- Indirect fire assets and 
effects to adjust 

- Close air support 
assets to direct/adjust 

- Results of close air 

COGNITIVE: 

Oral Expression; Oral 
Comprehension; 

Problem Sensitivity; 
Information Ordering; 
Spatial Orientation; 
Flexibility of Closure; 
Speed of Closure; 
Memorization; Time 
Sharing; 

SENSORY: 

- Affordances Present 

*5 - Excellent 

4 - Very Good 

3 - Good 

2 - Fair 

1 - Poor 
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Time Sharing; 

SENSORY: 

Night Vision; 

Peripheral Vision; 

Glare Sensitivity; 

Depth Perception; Far 
Vision; Near Vision; 
Auditory Attention; 
Speech Clarity; Speech 
Recognition; Hearing 
Sensitivity; Sound 
Localization 

PSYCHOMOTOR: 

Arm-Hand Steadiness; 
Manual Dexterity; 

Finger Dexterity; 

Control Precision; 
Multilimb 

Coordination; 

PHYSICAL: 

Extent Flexibility; 

support 

- Kill zone 

- Elements in kill zone 

- Stereoscopic sounds 
of battle (indirect, 
small arms, machine 
guns) 

- Urban or Suburban 
environment 
containing areas from 
which to conduct an 
ambush and respond 
to an ambush 
containing natural and 
manmade elements. 

- Binoculars/optics 

- Weather effects (i.e., 
heat, rain, dust, cold) 

- Weapon projectile 
effects 

Near Vision; Visual 
Color Discrimination; 
Speech Clarity; Speech 
Recognition; 

PSYCHOMOTOR: 

Manual Dexterity; 
Multilimb 

Coordination; 

PHYSICAL: 

None 



Support by fire 
elements lift and shift 
their suppressive fire as 
the elements in the kill 
zone assault through 
the enemy positions to 
destroy them. 

COGNITIVE: 

Oral Expression; Oral 
Comprehension; 
Inductive Reasoning; 
Problem Sensitivity; 
Information Ordering; 
Visualization; Spatial 
Orientation; flexibility 
of Closure; Speed of 
Closure; Perceptual 
Speed; Time Sharing; 

SENSORY: 

- Support by fire 
element 

- Assault element 

- Urban or Suburban 
environment 
containing areas from 
which to conduct an 
ambush and respond 
to an ambush 
containing natural and 
manmade elements. 

- Vehicles with crew 
served weapons 

COGNITIVE: 

Oral Expression; Oral 
Comprehension;; 

Problem Sensitivity; 
Information Ordering; 
Spatial Orientation; 
flexibility of Closure; 
Speed of Closure; 
Perceptual Speed; 
Memorization; Time 
Sharing; 

SENSORY: 

- Affordances present 

*5 - Excellent 

4 - Very Good 

3 - Good 

2 - fair 

1 - Poor 
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Night Vision; 

Peripheral Vision; 

Glare Sensitivity; 

Depth Perception; Far 
Vision; Near Vision; 
Visual Color 
Discrimination; 

Auditory Attention; 
Speech Clarity; Speech 
Recognition; Hearing 
Sensitivity; Sound 
Localization; 

PSYCHOMOTOR; 

Arm-Hand Steadiness; 
Manual Dexterity; 

Finger Dexterity; 

Control Precision; 
Response Orientation; 
Rate Control; 

Multilimb 

Coordination; Reaction 
Time; Speed of Limb 
Movement; 

PHYSICAL: 

Static Strength; 

Explosive Strength 
Dynamic Strength; 

Trunk Strength; 

Stamina; Extent 
Elexibility; Gross Body 
Coordination; Gross 
Body Equilibrium 

mounted 

- Personal weapons and 
protective gear 

- Ammunition 

- Smoke 

- Night Vision 
Devices/Weapon 
optics 

- Binoculars 

- Enemy forces 

- Enemy weapons 
effects 

- EM/Digital 
communication 
equipment 

- Communication link 
with element in kill 

zone 

- Weather effects (i.e., 
heat, rain, dust, cold) 

- Weapon projectile 
effects 

Near Vision; Visual 
Color Discrimination; 
Speech Clarity; Speech 
Recognition; Hearing 
Sensitivity; 

PSYCHOMOTOR: 

Manual Dexterity; 
Response Orientation; 
Multilimb 

Coordination; Reaction 
Time 

PHYSICAL: 

None 



The unit leader reports 
the contact to higher 
headquarters. 

See coordinate 
activities with CoC 

See coordinate 
activities with CoC 

See coordinate 
activities with CoC 

See coordinate 
activities with CoC 

3 tasks all rated 5 
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Post-conditions: 

Enemy destroyed or contact broken. Original mission continues 


124 




SCORE: 5.00 Excellent 


High Level Task: React to a possible static lEDA^BIED while mounted/dismounted 

Doctrine: stp21-1-2011; Individual Task 052-COM-1270; React to and lED Drill 05-3- 
D1703 

Preconditions: 

Task: 

1. Alert members of the element to the possible lED/VBIED and its location using the 3 
Ds (direction, distance, description). 

2. Establish security; scan for possible secondary/tertiary lEDs/VBIEDs using the 
5/25/100 meter checks. 

3. Conduct the 5 Cs—these can be done concurrently (check, confirm, clear, cordon, 
control) 

CHECK—All personnel should check their immediate area for secondary/tertiary 
devices. 

CONEIRM—The unit MUST confirm the existence of a suspected lED from a 
safe distance. Once confirmed, the unit calls in an EH SPOTREP and requests Explosive 
Ordnance Disposal (EOD). 

CEEAR—The unit clears the area around the device of all personnel, working 
from the device outwards. 

CORDON—Establish a security cordon around the danger area by setting up 
blocking positions to prevent foot and vehicle traffic from approaching the lED. 

CONTROE—The unit must control the area inside the cordon to ensure 
authorized access. 

4. Leader contacts and submits reports according to the unit’s standard operating 
procedure (SOP). 

Post-conditions: Area secure; higher headquarters/EOD informed 

DEFINITION OF SCALE 

5-Excellent - the TTE contains all but a few (90-100%) of the affordances determined 
during the analysis 

4-Very Good - the ITE contains a significant portion (70-89%) of the affordances 
determined during the analysis 

3-Good - the ITE contains a good portion (50-69%) of the affordances determined 
during the analysis 

2-Fair - the ITE contains some (25-49%) of the affordances determined during the 
analysis 

I-Poor - the ITE contains very few (0-24%) of the affordances determined during the 
analysis 
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Real World (RW) Preconditions: 

Environmental Evaluation 

RW Tasks 

RW Human Abilities 

RW Affordance 
Requirements 

Environment HA 

Environmental 

Affordances 

Level of Support to 
Training 

Alert element: 
direction, distance, 
description 

COGNITIVE: 

Oral Expression; 
Problem Sensitivity; 
Spatial Orientation; 
Flexibility of Closure; 
Speed of Closure; 
Perceptual Speed; 
Memorization; Time 
Sharing; 

SENSORY: 

Night Vision; 

Peripheral Vision; 

Glare Sensitivity; 

Depth Perception; Far 
Vision; Near Vision; 
Visual Color 
Discrimination; 

Speech Clarity; 

Hearing Sensitivity; 
Sound Focalization; 

PSYCHOMOTOR: 

Reaction Time; 

PHYSICAL: 

Extent Flexibility; 

- FM/Digital 
Communication 
equipment 
(redundant) 

- Communications 
link with other 
elements of 
unit/leader 

- Urban or Suburban 
environment 
containing areas 
from which to 
conduct an ambush 
and respond to an 
ambush containing 
natural and 
manmade elements. 

- Weather effects (i.e., 
heat, rain, dust, cold) 

- Personal protective 
equipment and 
weapons (i.e., 
helmet, IB AS, LBE, 
M4) 

- Ammunition 
(personal weapon 
and crew served) 

- Crew served 
weapons 

- Appropriate military 
vehicles with 
mounted crew served 
weapons 

COGNITIVE: 

Oral Expression; Oral 
Comprehension; 
Problem Sensitivity; 
Spatial Orientation; 
Flexibility of Closure; 
Speed of Closure; 
Perceptual Speed; 
Memorization; 

SENSORY: 

Near Vision; Visual 
Color Discrimination; 
Speech Clarity; 

Speech Recognition; 

PSYCHOMOTOR: 

Manual Dexterity; 
Multilimb 

Coordination; 

Reaction Time; 

PHYSICAL: 

None 

- All present 

*5 - Excellent 

4 - Very Good 

3 - Good 

2 - Fair 

1 - Poor 
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- Chain of Command 

- Observable lED 
threat or indicator of 
possible lED threat 

- A way to determine 
direction and 
distance (compass, 
GPS, Weapon sight, 
laser range finder, 
binoculars etc) 

- Night vision devices 




Establish security and 
scan for other devices 
using the 5/25/100 
method 

COGNITIVE: 

Oral Expression; Oral 
Comprehension; 
Deductive Reasoning; 
Inductive Reasoning; 
Problem Sensitivity; 
Information Ordering; 
Spatial Orientation; 
Elexibility of Closure; 
Speed of Closure; 
Perceptual Speed; 
Memorization; Time 
Sharing; 

SENSORY: 

Night Vision; 

Peripheral Vision; 

Glare Sensitivity; 

Depth Perception; Par 
Vision; Near Vision; 
Visual Color 
Discrimination; 

Speech Clarity; 

Speech Recognition; 
Hearing Sensitivity; 
Sound Localization; 

- Vehicles with crew 
served weapons 
mounted 

- Personnel with 
weapons and 
equipment 

- Ammunition 

- Vehicle optics 

- Weapon Optics 

- Weather/Climate 
conditions 

- Urban or suburban 
location/environment 
with sprawl 

- Orders from a leader 

- Location to create a 
security perimeter 

- Potential or observed 
threat/enemy 

- A way to determine 
direction and 
distance (compass, 
GPS, Weapon sight, 
laser range finder, 
binoculars etc) 

COGNITIVE: 

Oral Expression; Oral 
Comprehension; 
Problem Sensitivity; 
Spatial Orientation; 
Elexibility of Closure; 
Speed of Closure; 
Perceptual Speed; 
Memorization; Time 
Sharing; 

SENSORY: 

Near Vision; Visual 
Color Discrimination; 
Speech Clarity; 

Speech Recognition; 

PSYCHOMOTOR: 

Manual Dexterity; 
Multilimb 

Coordination; 

PHYSICAL: 

None 

- All Present 

*5 - Excellent 

4 - Very Good 

3 - Good 

2 - Eair 

1 - Poor 
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PSYCHOMOTOR: 

Arm-Hand Steadiness; 
Manual Dexterity; 
Finger Dexterity; 
Control Precision; 
Response Orientation; 
Rate Control; 

Multilimb 

Coordination; 

Reaction Time; 

PHYSICAL: 

Stamina; Extent 
Flexibility; Gross 

Body Coordination; 
Gross Body 

Equilibrium 

- FM/Digital 
communication 
equipment 

- Chain of command 




Check the 5 C’s 
- Check, Confirm, 
Clear, Cordon, 
Control 

COGNITIVE: 

Oral Expression; Oral 
Comprehension; 
Deductive Reasoning; 
Inductive Reasoning; 
Problem Sensitivity; 
Information Ordering; 
Category Flexibility; 
Visualization; Spatial 
Orientation; 

Flexibility of Closure; 
Speed of Closure; 
Perceptual Speed; 
Memorization; Time 
Sharing; 

SENSORY: 

Night Vision; 

Peripheral Vision; 

Glare Sensitivity; 

- Suspected device or 
threat 

- Personal weapons 
and personal 
protective equipment 

- Military vehicles 

- Crew served 
weapons 

- Ammunition 

- Materials to make 
obstacles from (e.g., 
wire, barriers, cones) 

- Means of FM/Digital 
communication 

- 360 degree field of 
view from device 
outward 

- Team members 

- Chain of Command 

COGNITIVE: 

Oral Expression; Oral 
Comprehension; 
Deductive Reasoning; 
Problem Sensitivity; 
Spatial Orientation; 
Flexibility of Closure; 
Speed of Closure; 
Perceptual Speed; 
Memorization; Time 
Sharing; 

SENSORY 

Near Vision; Visual 
Color Discrimination; 
Speech Clarity; 

Speech Recognition; 

PSYCHOMOTOR: 

Manual Dexterity; 

- Threat 

- POW/PPE 

- Vehicles 

- Crew Served 
weapons 

- Ammo 

- No materials to make 
obstacles 

- FM Comms via 
headsets 

- Avatars have 360 
degree visibility 

- AI scripted team 
members possible as 
well as other unit 
members 

- CoC 

- Urban/Suburban 
environment 

*5 - Excellent 

4 - Very Good 

3 - Good 

2 - Fair 

1 - Poor 

13 of 14 
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Depth Perception; Far 
Vision; Near Vision; 
Visual Color 
Discrimination; 

Speech Clarity; 

Speech Recognition; 
Hearing Sensitivity; 
Sound Localization; 

PSYCHOMOTOR: 

Arm-Hand Steadiness; 
Manual Dexterity; 
Finger Dexterity; 
Control Precision; 

Rate Control; 

Multilimb 

Coordination; Wrist- 
Finger Speed 

PHYSICAL: 

Trunk Strength; 

Stamina; Extent 
Flexibility; Gross 

Body Coordination; 
Gross Body 

Equilibrium 

- Urban or Suburban 
environment (e.g., 
buildings, roads, 
houses, farms, 
overpasses, etc) 

- Various Weather 
conditions (rain, 
heat, dust) 

- Night vision 
devices/optics 

- A means of marking 
areas that have been 
cleared 

Multilimb 

Coordination; 

PHYSICAL: 

None 

- Weather replicated 

- NVG Optics 

- Chemlights available 
for marking 


Leader contacts and 
submits reports 
according to the unit’s 
standard operating 
procedure (SOP). 

See coordinate 
activities with higher 
HQ 

See coordinate 
activities with higher 
HQ 

See coordinate 
activities with higher 
HQ 

See coordinate 
activities with higher 
HQ 

3 tasks all rated 5 

Post-conditions: 
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SCORE: 3.77 Very Good 


High Level Task: Conduct Recovery Operations 

Doctrine: ATP 4-25.13; Individual Task 081-833-0227 Coordinate Casualty Treatment 
and Evacuation 

Preconditions: lED or other event has occurred and rendered a vehicle or vehicles in 
need of recovery. 

Task: Recover Vehicle 

1. Determine if the vehicle can be recovered and repaired, or if it should be abandoned or 

destroyed. 

a. Visually inspect damaged vehicle 

b. Physically inspect damaged vehicle 

2. Eorward the battle damage report to higher headquarters. 

3. Determine requirements for recovery. 

a. Determine if the vehicle can be rapidly repaired and continue the mission. 

b. Determine if the vehicle can be moved using organic assets. 

c. Select recovery equipment and personnel in accordance with mission and 
capability. 

d. Select appropriate vehicle to conduct recovery. 

e. Eorward a SITREP to higher headquarters once recovery is complete. 

4. If organic assets are not capable of vehicle recovery, request external recovery support. 

a. Report location of vehicle. 

b. Report type of vehicle. 

c. Request specialized recovery support based on the disposition of the vehicle, its 

cargo, and the recommendations of the unit maintenance/recovery team. 

d. Coordinate route to the recovery site with higher headquarters. 

e. Coordinate security requirements with higher headquarters. 

f. Coordinate additional support as required (i.e., fire support, air support, 
firefighting support, environmental cleanup support, etc.) 

Post-conditions: Vehicle recovered or destroyed. 

DEFINITION OF SCALE 

5-Excellent - the TTE contains all but a few (90-100%) of the affordances determined 
during the analysis 

4-Very Good - the ITE contains a significant portion (70-89%) of the affordances 
determined during the analysis 

3-Good - the ITE contains a good portion (50-69%) of the affordances determined 
during the analysis 

2-Fair - the ITE contains some (25-49%) of the affordances determined during the 
analysis 
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1-Poor - the ITE contains very few (0-24%) of the affordances determined during the 
analysis 
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Real World (RW) Preconditions: 

lED or other event has occurred and rendered a vehicle or vehicles in need of 
recovery 

Environmental Evaluation 

RW Tasks 

RW Human Abilities 

RW Affordance 
Requirements 

Environment HA 

Environmental 

Affordances 

Level of Support to 
Training 

Visually inspect vehicle 
for damage 

COGNITIVE: 

Oral Comprehension; 
Oral Expression; 
Deductive Reasoning; 
Inductive Reasoning; 
Problem Sensitivity; 

SENSORY: 

Night Vision; 

Peripheral Vision; 

Glare Sensitivity; 

Depth Perception; Near 
Vision; Visual Color 
Discrimination; Speech 
Recognition; Speech 
Clarity; Hearing 
Sensitivity; Sound 
Localization; 

PSYCHOMOTOR: 

None 

PHYSICAL: 

None 

- Damaged military 
vehicle 

- Unit SOP for 
implementing 
recovery operation 

- Knowledge of vehicle 
maintenance/ vehicle 
operation 

- Urban or Suburban 
environment 
containing natural and 
manmade elements. 

- Weather effects (i.e., 
heat, rain, dust, cold) 

COGNITIVE: 

Problem Sensitivity; 
Spatial Orientation; 

SENSORY: 

Near Vision; Visual 
Color Discrimination; 

PSYCHOMOTOR: 

Manual Dexterity; 

PHYSICAL: 

None 

- Representation of 
damaged vehicle 

- Unit SOP’s assumed 
present and not 
expected from game 

- Scenario environment 
represented 

- Weather 

- Representation of 
vehicle maintenance 
knowledge not present 

5 - Excellent 
*4 - Very Good 

3 - Good 

2 - Eair 

1 - Poor 

4 of 5 present 

Physically inspect 
vehicle for damage 

Cannot execute task 

COGNITIVE: 

Oral Comprehension; 
Oral Expression; 
Deductive Reasoning; 
Inductive Reasoning; 
Problem Sensitivity; 

SENSORY: 

- Damaged military 
vehicle 

- Known standards 
(criteria) for recovery 
or destruction of unit 
equipment 

- Unit SOP for 
implementing 

*Cannot accomplish 


5 - Excellent 

4 - Very Good 

3 - Good 

2 - Eair 
*1 - Poor 
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Night Vision; 

Peripheral Vision; 

Glare Sensitivity; 

Depth Perception; Near 
Vision; Visual Color 
Discrimination; Speech 
Recognition; Speech 
Clarity; Hearing 
Sensitivity; Sound 
Localization; 

PSYCHOMOTOR: 

None 

PHYSICAL: 

None 

recovery operation 

- Knowledge of vehicle 
maintenance/ vehicle 
operation 

- Urban or Suburban 
environment 
containing natural and 
manmade elements. 

- Weather effects (i.e., 
heat, rain, dust, cold) 




Forward the battle 
damage report to higher 
headquarters. 

See coordinate 
activities with higher 

HQ 

See coordinate 
activities with higher 

HQ 

See coordinate 
activities with higher 

HQ 

See coordinate 
activities with higher 

HQ 

*5 - Excellent 

4 - Very Good 

3 - Good 

2 - Fair 

1 - Poor 

3 tasks rated 5 

Determine if the 
vehicle can be rapidly 
repaired through a 
physical inspection. 

Cannot accomplish 
task 

COGNITIVE: 

Oral Expression; Oral 
Comprehension; 
Deductive Reasoning; 
Fluency of Ideas; 
Inductive Reasoning; 
Originality; Problem 
Sensitivity; Information 
Ordering; Number 
Facility; Visualization; 
Spatial Orientation; 

Speed of Closure; 
Perceptual Speed; 
Memorization; Time 

- Damaged vehicle that 
can be externally 
inspected 

- Damaged vehicle that 
can be internally 
inspected 

*Cannot accomplish 

- Game does not afford 
the ability to 
physically inspect 
damaged equipment 

5 - Excellent 

4 - Very Good 

3 - Good 

2 - Fair 
*1 - Poor 
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Sharing; 

SENSORY: 

Night Vision; 

Peripheral Vision; 

Glare Sensitivity; 

Depth Perception; Far 
Vision; Near Vision; 
Visual Color 
Discrimination; Speech 
Clarity; Speech 
Recognition; Hearing 
Sensitivity; 

PSYCHOMOTOR: 

None 

PHYSICAL: 

Stamina; Extent 
Flexibility; Gross Body 
Coordination; Gross 

Body Equilibrium 





If vehicle cannot be 
rapidly repaired 
determine if the vehicle 
can be moved using 
available assets. 

COGNITIVE: 

Oral Expression; Oral 
Comprehension; 
Deductive Reasoning; 
Fluency of Ideas; 
Inductive Reasoning; 
Originality; Problem 
Sensitivity; Information 
Ordering; Number 
Facility; Visualization; 
Spatial Orientation; 

Speed of Closure; 
Perceptual Speed; 
Memorization; Time 
Sharing; 

- Damaged vehicle that 
can be externally 
inspected 

- Damaged vehicle that 
can be internally 
inspected 

- Information/Knowled 
ge of/about vehicle 
recovery capabilities 

COGNITIVE: 

Deductive Reasoning; 
Problem Sensitivity; 
Spatial Orientation; 

SENSORY: 

Near Vision; Visual 
Color Discrimination; 

PSYCHOMOTOR: 

Manual Dexterity; 
Multilimb 

Coordination; 

PHYSICAL: 

None 

- Damaged vehicle only 
visually inspectable 

- Scaled knowledge of 
recovery operations 
represented via game 
menus 

5 - Excellent 

4 - Very Good 
*3 - Good 

2 - Fair 

1 - Poor 

2 of 3 present 
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SENSORY: 

Night Vision; 

Peripheral Vision; 

Glare Sensitivity; 

Depth Perception; Far 
Vision; Near Vision; 
Visual Color 
Discrimination; Speech 
Clarity; Speech 
Recognition; Hearing 
Sensitivity; 

PSYCHOMOTOR: 

None 

PHYSICAL: 

Stamina; Extent 
Flexibility; Gross Body 
Coordination; Gross 
Body Equilibrium 





Select recovery 
equipment and 
personnel in 
accordance with 
mission and capability. 

COGNITIVE: 

Oral Expression; Oral 
Comprehension; 
Deductive Reasoning; 
Originality; Problem 
Sensitivity; Number 
Facility; Visualization; 
Spatial Orientation; 

Speed of Closure; 
Perceptual Speed; 
Memorization; Time 
Sharing; 

SENSORY: 

Night Vision; 

Peripheral Vision; 

Glare Sensitivity; 

- Element recovery 
assets (e.g., M88, tow 
bar, Wrecker) 

- Knowledge of 
recovery requirements 
and operations 

- Personnel available to 
conduct recovery 
operations 

- Undamaged vehicles 
to assist in vehicle 
recovery 

COGNITIVE: 

Oral Expression; Oral 
Comprehension; 
Deductive Reasoning; 
Problem Sensitivity; 
Spatial Orientation; 
Memorization; 

SENSORY: 

Near Vision; Visual 
Color Discrimination; 
Speech Clarity; Speech 
Recognition 

PSYCHOMOTOR: 

Manual Dexterity; 

- Various recovery 
types of vehicles are 
supported in model 
menu 

- Game represents 
recovery procedures 
via AI and menu 
options that 
automatically 
conducts actions such 
as connecting towing 
cables 

- Personnel may be 
scripted or controlled 
by other human 
trainees 

- Unit equipment that 

*5 - Excellent 

4 - Very Good 

3 - Good 

2 - Fair 

1 - Poor 

All Present 
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Depth Perception; Far 
Vision; Near Vision; 
Visual Color 
Discrimination; Speech 
Clarity; Speech 
Recognition; Hearing 
Sensitivity; 


PHYSICAL: 

None 

can be used for 
recovery is 
represented 



PSYCHOMOTOR: 

None 






PHYSICAL: 

Stamina; Extent 
Flexibility; Gross Body 
Coordination; Gross 
Body Equilibrium 





Position recovery 
vehicle in position to 
tow damaged vehicle 
and connect damaged 
vehicle to recovery 
vehicle. 

COGNITIVE: 

Oral Expression; Oral 
Comprehension; 
Deductive Reasoning; 
Fluency of Ideas; 
Inductive Reasoning; 
Originality; Problem 
Sensitivity; Information 
Ordering; Number 
Facility; Visualization; 
Spatial Orientation; 

Speed of Closure; 
Perceptual Speed; 
Memorization; Time 
Sharing; 

SENSORY: 

Night Vision; 

Peripheral Vision; 

Glare Sensitivity; 

Depth Perception; Far 

- Damaged vehicle 

- Organic recovery 
assets (e.g., M88, 
Wrecker, other 
vehicles, tow bars, 
tow cables) 

- Knowledge of 
recovery requirements 
and operations 

COGNITIVE: 

Oral Expression; Oral 
Comprehension; 

Problem Sensitivity; 
Spatial Orientation; 

SENSORY: 

Near Vision; Visual 
Color Discrimination; 
Speech Clarity; Speech 
Recognition; 

PSYCHOMOTOR: 

Manual Dexterity; 
Multilimb 

Coordination; 

PHYSICAL: 

None 

- Damaged vehicle 

- Organic and special 
recovery asset models 
available 

- Scaled representation 
of Knowledge to 
execute recovery 
operations present via 
AI or menu options 

*5 - Excellent 

4 - Very Good 

3 - Good 

2 - Fair 

1 - Poor 

All Present 
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Vision; Near Vision; 
Visual Color 
Discrimination; Speech 
Clarity; Speech 
Recognition; Hearing 
Sensitivity; 
PSYCHOMOTOR: 
None 

PHYSICAL: 

Stamina; Extent 
Flexibility; Gross Body 
Coordination; Gross 
Body Equilibrium 





If organic assets are not 

See coordinate 

See coordinate 

See coordinate 

See coordinate 

**The task of 

capable of vehicle 

activities with higher 

activities with higher 

activities with higher 

activities with higher 

coordinating resources 

recovery, request 
external recovery 
support. 

a. Report location of 
vehicle. 

b. Report type of 
vehicle. 

c. Request specialized 
recovery support based 
on the disposition of 
the vehicle, its cargo, 
and the 

recommendations of 
the unit 

maintenance/recovery 

team. 

d. Coordinate route to 

HQ 

HQ 

HQ 

HQ 

and information with 
higher headquarters has 
already been 
incorporated into this 
analysis and will not be 
scored here. 
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the recovery site with 
higher headquarters. 

e. Coordinate security 
requirements with 
higher headquarters. 

f. Coordinate additional 
support as required 
(i.e., fire support, air 
support, firefighting 
support, environmental 
cleanup 

support, etc.) 

Post-conditions: Vehicle recovered or destroyed 





SCORE: 2.33 Fair 


High Level Task: Conduct CASEVAC Operations 

Doctrine: ATP 4-25.13; Individual Task 081-833-0227 Coordinate Casualty Treatment 
and Evaeuation 

Preconditions: Initial first aid has been rendered to the easualty. MEDEVAC has been 
ealled. Casualty has been earned to a military vehiele that will earry him/her to the 
easualty eolleetion point (CCP) for MEDEVAC or to the aid station. 

**NOTE** CASEVAC refers to the movement of easualties aboard nonmedieal vehieles 
or aireraft. Care is rendered while the easualty is awaiting piekup or is being transported. 
A Soldier aeeompanying an uneonseious easualty should monitor the easualty's airway, 
breathing, and bleeding 

Task: 

1. Drive easualty to CCP. 

2. Render buddy/first aid to easualty in route to CCP/aid station. 

3. Monitor/maintain/eontrol easualties airway and breathing and bleeding. 

Post-conditions: Casualty moved to CCP/aid station. 


DEFINITION OF SCALE 

5-Excellent - the TTE eontains all but a few (90-100%) of the affordanees determined 
during the analysis 

4-Very Good - the ITE eontains a signifieant portion (70-89%) of the affordanees 
determined during the analysis 

3-Good - the ITE eontains a good portion (50-69%) of the affordanees determined 
during the analysis 

2-Fair - the ITE eontains some (25-49%) of the affordanees determined during the 
analysis 

I-Poor - the ITE eontains very few (0-24%) of the affordanees determined during the 
analysis 
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Real World (RW) Preconditions: 

Initial first aid has been rendered to the casualty. MEDEVAC has been 
called. Casualty has been carried to a military vehicle that will carry him/her 
to the casualty collection point (CCP) for MEDEVAC or to the aid station. 

Environmental Evaluation 


RW Tasks 

RW Human Abilities 

RW Affordance 
Requirements 

Environment HA 

Environmental 

Affordances 

Level of Support to 
Training 

Drive casualty to CCP 

COGNITIVE: 

Problem Sensitivity; 
Information Ordering; 
Spatial Orientation; 

Speed of Closure; 
Perceptual Speed; 
Memorization; Time 
Sharing; 

SENSORY: 

Night Vision; 

Peripheral Vision; 

Glare Sensitivity; 

Depth Perception; Par 
Vision; Near Vision; 
Visual Color 
Discrimination; Speech 
Clarity; Speech 
Recognition; Hearing 
Sensitivity; 

PSYCHOMOTOR: 

Arm-Hand Steadiness; 
Manual Dexterity; 
Control Precision; 
Response Orientation; 
Multilimb 

Coordination; Reaction 
Time; 

PHYSICAL: 

- Urban or Suburban 
environment 
containing natural and 
manmade elements. 

- Weather effects (i.e., 
heat, rain, dust, cold) 

- Non-Medical military 
transport vehicles that 
contain the necessary 
controls for vehicular 
control and movement 
(e.g., steering 
mechanism, 
accelerator 
mechanism, brake 
mechanism) 

- Route of travel 

- Destination (i.e., CCP 
or aid station) 

- Potential and actual 
threats and obstacles 

- Driver 

COGNITIVE: 

Spatial Orientation; 

Speed of Closure; 
Memorization; Time 
Sharing; 

SENSORY: 

Near Vision; Visual 
Color Discrimination; 

PSYCHOMOTOR: 

Manual Dexterity; 
Multilimb 

Coordination; Reaction 
Time; 

PHYSICAL: 

Extent Plexibility; 

- Steering wheel and 
pedals 

- Non-Standard 

Medical Vehicle 
represented in game 
environment 

- Physical environment 
represented in Game 

- Route of travel 

- Destination 

- Driver either AI or 
other human trainee 

*5 - Excellent 

4 - Very Good 

3 - Good 

2 - Pair 

1 - Poor 
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Stamina; Extent 
Flexibility; 





Render buddy/first aid 
to casualty in route to 
CCP/aid station. 

Cannot accomplish 
task 

COGNITIVE: 

Oral Expression; Oral 
Comprehension; 
Deductive Reasoning; 
Inductive Reasoning; 
Originality; Problem 
Sensitivity; Information 
Ordering; 

Visualization; Spatial 
Orientation; Flexibility 
of Closure; Speed of 
Closure; Perceptual 
Speed; Memorization; 
Time Sharing; 

SENSORY: 

Night Vision; 

Peripheral Vision; 

Depth Perception; Near 
Vision; Visual Color 
Discrimination; 

Auditory Attention; 
Speech Clarity; Speech 
Recognition; Hearing 
Sensitivity; 

PSYCHOMOTOR: 

Arm-Hand Steadiness; 
Manual Dexterity; 

Finger Dexterity; 
Response Orientation; 
Multilimb 

Coordination; Wrist- 
Finger Speed; Reaction 
Time; Speed of Fimb 

- Unit members who 
have received training 
in combat first aid 

- First Aid/Combat 
Fifesaver bag 
containing medical 
supplies 

- Casualty 

- Urban or Suburban 
environment 
containing natural and 
manmade elements. 

- Weather effects (i.e., 
heat, rain, dust, cold) 

- Coordinating 
communication 
between unit members 

- Non-medical vehicle 

**Cannot accomplish 


5 - Excellent 

4 - Very Good 

3 - Good 

2 - Fair 
*1 - Poor 
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Movement; 

PHYSICAL: 

Dynamic Strength; 
Stamina; Extent 
Flexibility 





Monitor/maintain/ 
control casualty’s 
airway and breathing 
and bleeding. 

Cannot accomplish 
Task 

COGNITIVE: 

Problem Sensitivity; 
Information Ordering; 
Memorization; Time 
Sharing; 

SENSORY: 

Night Vision; 

Peripheral Vision; 

Depth Perception; Near 
Vision; Visual Color 
Discrimination; 

Auditory Attention; 
Speech Clarity; Speech 
Recognition; Hearing 
Sensitivity; Sound 
Localization 

PSYCHOMOTOR: 

Arm-Hand Steadiness; 
Manual Dexterity; 

Finger Dexterity; 
Response Orientation; 
Multilimb 

Coordination; Wrist- 
Finger Speed; Reaction 
Time; Speed of Limb 
Movement; 

PHYSICAL: 

Dynamic Strength; 

- Unit members who 
have received training 
in combat first aid 

- First Aid/Combat 
Lifesaver bag 
containing medical 
supplies 

- Casualty 

- Urban or Suburban 
environment 
containing natural and 
manmade elements. 

- Weather effects (i.e., 
heat, rain, dust, cold) 

- Non-medical military 
vehicle 

**Cannot accomplish 


5 - Excellent 

4 - Very Good 

3 - Good 

2 - Fair 
*1 - Poor 
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Stamina; Extent 
Flexibility 





Post-conditions: Casualty moved to CCP/aid station 
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SCORE: 5.00 Excellent 


High Level Task: Comply with rules of engagement (ROE) 

Doctrine: STP 21-1-SMCT; FM 27-10 Law of land warfare; Individual Task 171-300- 
0083 Enforce Rules of Engagement (ROE); Individual task 71-300-0011 Employ 
progressive levels of force when confronting civilians; Individual task 181-105- 
1001 Comply with the Law of War and the Geneva and Hague Conventions 


Preconditions: Soldier is provided with the rules of engagement (ROE) and escalation of 
force (EOE) guidelines. 

Task: Comply with the rules of engagement (ROE) 

Post-conditions: ROE/EOE observed and obeyed 


DEFINITION OF SCALE 

5-Excellent - the ETE contains all but a few (90-100%) of the affordances determined 
during the analysis 

4-Very Good - the ITE contains a significant portion (70-89%) of the affordances 
determined during the analysis 

3-Good - the ITE contains a good portion (50-69%) of the affordances determined 
during the analysis 

2-Fair - the ITE contains some (25-49%) of the affordances determined during the 
analysis 

I-Poor - the ITE contains very few (0-24%) of the affordances determined during the 
analysis 
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Real World (RW) Preconditions 

ROE and SOPs are provided to SM and measures to check understanding 
have been executed 

Environmental Evaluation 

Assessment of this task focused mainly on soldier understanding of the ROE 
based on Soldier actions and inactions as well as the environments ability to 
provide situations where the soldier is able to identify and determine items 
such as a hostile act, hostile intent, hostile force. Without specific ROE 
determining the human abilities necessary is problematic. 

RW Tasks 

RW Human Abilities 

RW Affordance 
Requirements 

Environment HA 

Environmental 

Affordances 

Level of Support to 
Training 

Comply with ROE 

COGNITIVE: 

Oral Expression; Oral 
Comprehension; 

Written 

Comprehension; 
Deductive Reasoning; 
Inductive Reasoning;; 
Problem Sensitivity; 
Information Ordering; 
Category Elexibility; 
Visualization; Spatial 
Orientation; Elexibility 
of Closure; Speed of 
Closure; Perceptual 
Speed; Memorization; 
Selective Attention; 

Time Sharing; 

SENSORY: 

Night Vision; 

Peripheral Vision; 

Glare Sensitivity; 

Depth Perception; Par 
Vision; Near Vision; 
Visual Color 
Discrimination; 

Auditory Attention; 
Speech Clarity; Speech 
Recognition; Hearing 

- ROE 

- Events where Soldiers 
have to apply their 
understanding and 
interpretation of the 
ROE 

- Enforcer of the ROE 

- Punishment for 
violation of the ROE 

- Standards for 
applying Escalation of 
Porce (EOP) 

- Unit SOPs for 
detainee operations 
and handling 

COGNITIVE: 

Oral Expression; Oral 
Comprehension; 
Deductive Reasoning; 
Inductive Reasoning; 
Problem Sensitivity; 
Information Ordering; 
Spatial Orientation; 
Elexibility of Closure; 
Speed of Closure; 
Perceptual Speed; 
Memorization; Time 
Sharing; 

SENSORY: 

Near Vision; Visual 
Color Discrimination; 
Speech Clarity; Speech 
Recognition 

PSYCHOMOTOR: 

Manual Dexterity; 
Response Orientation; 
Rate Control; Reaction 
Time; 

PHYSICAL: 

None 

- ROE assumed present 
and provided and is 
external of the game 
environment 

- Standards for 
applying EOP 
assumed present 

- Scenario editor allows 
for the development 
of scenarios that place 
trainees in situations 
where they must 
apply ROE 
appropriately 

- Enforcement of ROE 
may be scripted into 
the scenario 

- Punishment for 
violating ROE may be 
scripted into the 
scenario 

- Unit SOP’s assumed 
present 

*5 - Excellent 

4 - Very Good 

3 - Good 

2 - Pair 

1 - Poor 

All present 
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Sensitivity; Sound 
Localization; 

PSYCHOMOTOR: 

Arm-Hand Steadiness; 
Manual Dexterity; 

Finger Dexterity; 

Control Precision; 
Response Orientation; 
Rate Control; 

Multilimb 

Coordination; Wrist- 
Finger Speed; Reaction 
Time; Speed of Limb 
Movement; 

PHYSICAL: 

Static Strength; 

Explosive Strength 
Dynamic Strength; 

Trunk Strength; 

Stamina; Extent 
Flexibility; Dynamic 
Flexibility; Gross Body 
Coordination; Gross 
Body Equilibrium 





Post-conditions: Rules of engagement/ EOF are observed and obeyed 
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SCORE: 5.00 Excellent 


High Level Task: Scan my sector appropriately 
Doctrine: STP 21-1-SMCT 

Preconditions: SM informed of sector of responsibility for scanning; SM knowledgeable 
of appropriate search patterns 

Task: 

1. Confirm sector of assigned responsibility 

2. Using optics and eyes: Observe an area of assigned responsibility for threats using an 

appropriate search pattern. 


Post-conditions: Visual observation and scan for enemy threats is conducted to standard 


DEFINITION OF SCALE 

5-Excellent - the ITE contains all but a few (90-100%) of the affordances determined 
during the analysis 

4-Very Good - the ITE contains a significant portion (70-89%) of the affordances 
determined during the analysis 

3-Good - the ITE contains a good portion (50-69%) of the affordances determined 
during the analysis 

2-Fair - the ITE contains some (25-49%) of the affordances determined during the 
analysis 

I-Poor - the ITE contains very few (0-24%) of the affordances determined during the 
analysis 
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Real World (RW) Preconditions: Sector of responsibility for 
visual/optical/weapons scan is provided to the SM. 

Environmental Evaluation 

RW Tasks 

RW Human Abilities 

RW Affordance 

Environment HA 

Environmental 

Level of Support to 



Requirements 


Affordances 

Training 

Confirm sector of 

COGNITIVE: 

- Weather/Climate 

COGNITIVE: 

- Scenario editor that 

*5 - Excellent 

responsibility 

Oral Expression; Oral 

- Urban/Suburban 

Oral Expression; Oral 

allows for the 

4 - Very Good 


Comprehension; 

environment with 

Comprehension; 

building of scenarios 

3 - Good 


Spatial Orientation; 

sprawl 

Spatial Orientation; 

containing weapons. 

2 - Fair 


Flexibility of Closure; 

- Identifiable terrain or 

Flexibility of Closure; 

optics, replication of 

1 - Poor 



other features 

Memorization; Time 

weather/climate. 



SENSORY: 

- Optics (Weapon, 

Sharing; 

terrain, enemy units. 

All present 


Night Vision; 

Vehicle, Personal) 


friendly units. 



Peripheral Vision; 

- A Means of 

SENSORY: 

vehicles; pedestrians 



Glare Sensitivity; 

communication with 

Near Vision; Visual 

etc. 



Depth Perception; Far 

leader (FM/Digital 

Color Discrimination; 

- Avatar with 1“^' person 



Vision; Near Vision; 

communication 

Auditory Attention; 

or 3'^'^ person view 



Visual Color 

device 

Speech Clarity; Speech 

wearing appropriate 



Discrimination; Speech 


Recognition; 

personal clothing and 



Clarity; Speech 



equipment 



Recognition; 


PSYCHOMOTOR: 

- Headset to 





Finger Dexterity; Rate 

communicate with 



PSYCHOMOTOR: 


Control; Multilimb 

others 



None 


Coordination; Wrist- 

- Keyboard control 





Finger Speed; 

cheat sheet 



PHYSICAL: 



- Mouse 



None 


PHYSICAL: 






None 



Using optics/eyes: 

COGNITIVE: 

- Area to observe 

COGNITIVE: 

- Keyboard control 

*5 - Excellent 

observe an area of 

Spatial Orientation; 

- Potential threat 

Spatial Orientation; 

cheat sheet 

4 - Very Good 

assigned responsibility 

Memorization; 

activity 

Flexibility of Closure; 

- Mouse 

3 - Good 

for threats using an 

Selective Attention; 


Speed of Closure; 

- Keyboard 

2 - Fair 

appropriate search 

Speed of closure; 


Memorization; Time 

- Scenario editor that 

1 - Poor 

pattern 

Flexibility of Closure 


Sharing; 

allows for the 






building of scenarios 

All present 


SENSORY: 


SENSORY: 

containing weapons. 



Night Vision; 


Near Vision; Visual 

optics, replication of 



Peripheral Vision; 


Color Discrimination; 

weather/climate. 
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Glare Sensitivity; 

Depth Perception; Far 
Vision; Near Vision; 
Visual Color 
Discrimination; 

Auditory Attention; 
Speech Clarity; Speech 
Recognition; Hearing 
Sensitivity; Sound 
Localization; 

PSYCHOMOTOR: 

Arm-Hand Steadiness; 
Manual Dexterity; 

Finger Dexterity; 
Multilimb 

Coordination; 

PHYSICAL: 

Extent Flexibility; 


PSYCHOMOTOR: 

Finger Dexterity; 
Response Orientation; 
Rate Control; 

Multilimb 

Coordination; Wrist- 
Finger Speed; Reaction 
Time; 

PHYSICAL: 

None 

terrain, enemy units, 
friendly units, 
vehicles; pedestrians 
etc. 

- Avatar whose eyes 
the trainee views the 
environment 


Post-conditions: Observation and scan for enemy threats is conducted to standard 
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SCORE: 3.67 Very Good 


High Level Task: Communicate with members of your unit 

Doctrine: FM 21-60 Visual Signals; Individual Task 171-170-0008 Submit reports using 
FBCB2; Individual Task 171-170-0001 Submit messages using FBCB2 

Preconditions: 

Task: 

1. Transmit information to unit members verbally 

2. Transmit information to unit members via digital systems 

3. Transmit information to unit members via hand and arm signals 

Post-conditions: Information is passed to unit members. 

DEFINITION OF SCALE 

5-Excellent - the TTE contains all but a few (90-100%) of the affordances determined 
during the analysis 

4-Very Good - the ITE contains a significant portion (70-89%) of the affordances 
determined during the analysis 

3-Good - the ITE contains a good portion (50-69%) of the affordances determined 
during the analysis 

2-Fair - the ITE contains some (25-49%) of the affordances determined during the 
analysis 

I-Poor - the ITE contains very few (0-24%) of the affordances determined during the 
analysis 
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Real World (RW) Preconditions: 

Environmental Evaluation 

RW Tasks 

RW Human Abilities 

RW Affordance 
Requirements 

Environment HA 

Environmental 

Affordances 

Level of Support to 
Training 

Transmit and receive 
information verbally 

COGNITIVE: 

Oral Expression; Oral 
Comprehension 

SENSORY: 

Speech Clarity; Speech 
Recognition; 

PSYCHOMOTOR: 

None 

PHYSICAL: 

None 

- Audience to receive 
communication 

- Information to 
transmit 

- A way to send and 
receive verbal 
communications 

COGNITIVE: 

Oral Expression; Oral 
Comprehension; 

SENSORY: 

Speech Clarity; Speech 
Recognition; 

PSYCHOMOTOR: 

None 

PHYSICAL: 

None 

- Audience 

- Means to transmit via 
headset and simulated 
PM radio 

*5 - Excellent 

4 - Very Good 

3 - Good 

2 - Pair 

1 - Poor 

Transmit and receive 
information digitally 

Task not possible; No 
digital communication 
capability replicated 

COGNITIVE: 

Oral Expression; Oral 
Comprehension; 

Written 

Comprehension; 

Written Expression; 

SENSORY: 

Near Vision; Auditory 
Attention; Speech 
Clarity; Speech 
Recognition; Hearing 
Sensitivity; Sound 
Localization; 

PSYCHOMOTOR: 

Arm-Hand Steadiness; 
Linger Dexterity; 

PHYSICAL: 

- Audience to receive 
communication 

- Information to 
transmit 

- A way to send and 
receive digital 
communications 

**Not supported** 


5 - Excellent 

4 - Very Good 

3 - Good 

2 - Pair 
*1 - Poor 
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None 





Transmit and receive 
information using hand 
and arm signals or with 
other visual devices 

COGNITIVE: 

Information Ordering; 
Spatial Orientation; 
Speed of Closure; 
Perceptual Speed; 
Memorization; Time 
Sharing; 

SENSORY: 

Night Vision; 

Peripheral Vision; 

Glare Sensitivity; 

Depth Perception; Far 
Vision; Near Vision; 
Visual Color 
Discrimination; 

PSYCHOMOTOR: 

Arm-Hand Steadiness; 
Manual Dexterity; 
Response Orientation; 
Multilimb 

Coordination; Wrist- 
Finger Speed; 

PHYSICAL: 

Extent Flexibility; 

- Audience to receive 
communication with 
range to view hand 
and arm signals with 
naked eye 

- Information to 
transmit 

- Visual enhancement 
device (e.g., 
binoculars) 

- Visual signaling 
devices (e.g., Red, 
Green, Yellow flags. 
Colored flashlight 
lenses) 

COGNITIVE: 

Information Ordering; 
Spatial Orientation; 
Flexibility of Closure; 
Speed of Closure; 
Perceptual Speed; 
Memorization; Time 
Sharing; 

SENSORY: 

Near Vision; Visual 
Color Discrimination; 

PSYCHOMOTOR: 

Manual Dexterity; 
Response Orientation; 

PHYSICAL: 

None 

- Audience 

- Information 

- Optics and visual 
enhancement devices 
replicated 

- Signaling via 
chemical lights and 
other means possible 

*5 - Excellent 

4 - Very Good 

3 - Good 

2 - Eair 

1 - Poor 

Post-conditions: 
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SCORE: 5.00 Excellent 


High Level Task: Coordinate activities with your chain of command (CoC) 

Doctrine: Task Number: 34-2-0010 Task Title: Report Taetieal Information 
Preconditions: 

Task: 

1. The element observes threat or other aetivities that are reportable in 
aeeordanee with the TACSOP. 

2. The element reports to their immediate element leader a deseription of the 
aetivities observed. 

3. The element leader reports to higher headquarters using SALUTE via 
taetieal FM radio or other taetieal means. 

a. Size: Express as a quantity or Eehelon 

b. Aetivity: What is happening should be a eoneise bullet statement. 

e. Eoeation: An 8 or 10 digit grid eoordinate, or an address, if 

appropriate. 

d. Unit: Who is performing the aetivity? Designate the unit or 
identify a group or individual. 

e. Time: When the aetivity was observed, or if ongoing when it was 
initiated. 

f. Equipment: Deseribe/identify any equipment 

g. Remarks: Identify any other pertinent/time sensitive information 
that must be passed. 


Post-conditions: Activities of unit are known to CoC. 

DEFINITION OF SCALE 

5-Excellent - the TTE contains all but a few (90-100%) of the affordances determined 
during the analysis 

4-Very Good - the ITE contains a significant portion (70-89%) of the affordances 
determined during the analysis 

3-Good - the ITE contains a good portion (50-69%) of the affordances determined 
during the analysis 

2-Fair - the ITE contains some (25-49%) of the affordances determined during the 
analysis 

I-Poor - the ITE contains very few (0-24%) of the affordances determined during the 
analysis 
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Real World (RW) Preconditions: 

Environmental Evaluation 

RW Tasks 

RW Human Abilities 

RW Affordance 
Requirements 

Environment HA 

Environmental 

Affordances 

Level of Support to 
Training 

The element observes 
threat or other 
activities that are 
reportable in 
accordance with the 
TACSOP 

COGNITIVE: 

Oral Comprehension; 
Deductive Reasoning; 
Inductive Reasoning; 
Speed of Closure; 
Problem Sensitivity; 
Information Ordering; 
Number Facility; 

Spatial Orientation; 
Flexibility of Closure; 
Perceptual Speed; 
Memorization; Time 
Sharing; Selective 
Attention 

SENSORY: 

Night Vision; 

Peripheral Vision; 

Glare Sensitivity; 

Depth Perception; Far 
Vision; Near Vision; 
Visual Color 
Discrimination; 

Speech Recognition; 
Hearing Sensitivity; 
Sound Localization; 

PSYCHOMOTOR: 

Arm-Hand Steadiness; 
Manual Dexterity; 

Finger Dexterity; 
Multilimb 

Coordination; Wrist- 

- Urban or Suburban 
environment 
containing natural 
and manmade 
elements 

- Weather /climate 
effects (i.e., heat, 
rain, dust, cold) 

- Personal protective 
equipment and 
weapons (i.e., helmet, 
IB AS, LBE, M4) 

- Ammunition 
(personal weapon and 
crew served) 

- Crew served weapons 

- Appropriate military 
vehicles with 
mounted crew served 
weapons 

- Chain of Command 

- Observable threat or 
indicator of possible 
threat 

- A way to determine 
direction and distance 
(compass, GPS, 
Weapon sight, laser 
range finder, 
binoculars etc) 

- Night vision devices 

- ROE 

COGNITIVE: 

Problem Sensitivity; 
Spatial Orientation; 
Elexibility of Closure; 
Speed of Closure; 
Memorization; Time 
Sharing; 

SENSORY: 

Near Vision; Visual 
Color Discrimination; 

PSYCHOMOTOR: 

Manual Dexterity; 

Rate Control; 

PHYSICAL: 

None 

- All present 

- Assumed that ROE is 
provided externally 
to the game 

*5 - Excellent 

4 - Very Good 

3 - Good 

2 - Eair 

1 - Poor 
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Finger Speed; 

PHYSICAL: 

Extent Flexibility 

- Other unit members 




The element reports to 
their immediate 
element leader a 
description of the 
activities observed. 

COGNITIVE: 

Oral Expression; Oral 
Comprehension; 

Problem Sensitivity; 
Information Ordering; 
Number Facility; 

Spatial Orientation; 
Memorization 

SENSORY: 

Speech Clarity; Speech 
Recognition; Hearing 
Sensitivity 

PSYCHOMOTOR: 

Arm-Hand Steadiness; 
Manual Dexterity; 

PHYSICAL: 

Extent Flexibility; 

- FM/Digital 
Communication 
equipment 

- Communications link 
with other elements 
of unit/leader 

- Reporting SOP 

- Report Format 

COGNITIVE: 

Oral Expression; Time 
Sharing; 

SENSORY: 

Near Vision; Visual 
Color Discrimination; 

PSYCHOMOTOR: 

Manual Dexterity 

PHYSICAL: 

None 

- 4 radio nets 
represented in game 

- FM capability 
represented no digital 

- Reporting SOP and 
Format external to 
game 

- Headsets for 
communications 

*5 - Excellent 

4 - Very Good 

3 - Good 

2 - Fair 

1 - Poor 

The element leader 
reports to higher 
headquarters using 
SALUTE via tactical 

FM radio or other 
tactical means. 

a. Size: Express as a 
quantity or Echelon 

b. Activity: What is 
happening should be a 
concise bullet 

COGNITIVE: 

Oral Expression; 

Written 

Comprehension; 

Problem Sensitivity; 
Information Ordering; 
Number Facility; 

Spatial Orientation; 
Flexibility of Closure; 
Speed of Closure; 
Perceptual Speed; 
Memorization; Time 
Sharing; 

- FM/Digital 
Communication 
equipment 

- Communications link 
with other elements 
of unit/leader 

- Reporting SOP 

- Report Format 

- Information about: 

—Enemy element size 

—Enemy Activity 

—Location of threat 

COGNITIVE: 

Oral Expression; 

Written 

Comprehension; 

Problem Sensitivity; 
Information Ordering; 
Number Facility; 

Spatial Orientation; 
Flexibility of Closure; 
Speed of Closure; 
Perceptual Speed; 
Memorization; Time 
Sharing 

- 4 radio nets 
represented in game 

- FM capability 
represented no digital 

- Reporting SOP and 
Format external to 
game 

- Headsets for 
communications 

*5 - Excellent 

4 - Very Good 

3 - Good 

2 - Fair 

1 - Poor 
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statement. 

c. Location; An 8 or 10 
digit grid coordinate, 
or an address, if 
appropriate. 

d. Unit; Who is 
performing the 
activity? Designate the 
Unit or identify a 
group or individual. 

e. Time; When the 
activity was observed, 
or if ongoing when it 
was initiated. 

f. Equipment; 
Describe/Identify any 
equipment 

g. Remarks; Identify 
any other 

pertinent/time sensitive 
information that must 
be passed. 

SENSORY: 

Night Vision; Near 
Vision; Speech Clarity; 
Hearing Sensitivity; 

PSYCHOMOTOR: 

Arm-Hand Steadiness; 
Manual Dexterity; 

PHYSICAL: 

Extent Elexibility 

—Own Unit 
designation 
—Time of contact 
—Enemy equipment 
—Any additional 
information about 
situation that the 
leader wants to add 
or is required per 

SOP 

- Chain of command 

SENSORY: 

Near Vision; 
PSYCHOMOTOR: 

Manual Dexterity; 

PHYSICAL: 

None 



Post-conditions: 
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APPENDIX E. ANALYSIS OF ESC 


The following pages provide the first analysis of the FSC action items using 
ITEAM. This analysis used the original five-point rating scale for scoring. 


Action Item: Analyze the Enemy Situation Very Good 3.66 

Doctrine: FM 3-21.8, 3-21.10, 5-0 

Preconditions: Trainee has knowledge of enemy doctrine and weapons capabilities; 
Trainee receives information from his higher headquarters including an enemy situational 
template (SITTEMP), current intelligence assumptions regarding enemy capabilities (i.e., 
composition, disposition, strength and recent activities); Trainee has conducted an 
analysis of the terrain and weather conditions within the area of interest and area of 
operations. 

Task: Analyze the Enemy Situation 

1. Trainee processes all provided information about the enemy capabilities with his own 

knowledge of and experience with the threat. 

2. Trainee reviews the current enemy situational template depicting the disposition of 

forces 

3. Trainee considers the enemy intelligence information in conjunction with the terrain 

and weather data provided 

4. Trainee repeats steps 1-3 as new information becomes available. 

Post-conditions: Trainee has understanding of current enemy situation; Trainee has 
insight into possible future enemy courses of action 


DEFINITION OF SCALE 

5-Excellent - the TTE contains all but a few (90-100%) of the affordances determined 
during the analysis 

4-Very Good - the ITE contains a significant portion (70-89%) of the affordances 
determined during the analysis 

3-Good - the ITE contains a good portion (50-69%) of the affordances determined 
during the analysis 

2-Fair - the ITE contains some (25-49%) of the affordances determined during the 
analysis 
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1-Poor - the ITE contains very few (0-24%) of the affordances determined during the 
analysis 


Evaluation Comments: 

Several ESC scenarios provide the trainee with information about the threat but no enemy 
situational templates are provided as part of the game. The games scenario editor allows 
for as much or as little information about the enemy to be included in the Battalion 
Operations orders, which we believe negates the absence of the situational template. The 
game contains the ability to add or delete map data as desired. 

ESC supports the training of this action item. Overall rating: Very Good 3.66 
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Real World (RW) Preconditions: 

Trainee has knowledge of enemy doctrine and weapons capabilities; 

Trainee receives information from his higher headquarters including an 
enemy situational template (SITTEMP), current intelligence assumptions 
regarding enemy capabilities (i.e., composition, disposition, strength and 
recent activities); 

Trainee receives current information about weather and terrain conditions 
within the area of interest and area of operations 

Environment Evaluation 

Enemy situational template is not provided by the system. 

RW Tasks 

RW Human Abilities 

RW Affordance 
Requirements 

Environment HA 

Environmental 

Affordances 

Level of Support to 
Training 

Trainee processes the 
information provided to 
him about the enemy 
with his own 
knowledge of and 
experience with the 
threat 

COGNITIVE: 

Oral comprehension; 
Written 

comprehension; 

Inductive Reasoning; 
Problem Sensitivity; 
Spatial Orientation; 

Speed of Closure; 
Memorization 

SENSORY: 

Near Vision 

PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity 

PHYSICAL: 

None 

- Composition and 
strength of enemy 
force 

- Enemy most likely 
course of action 

- Enemy weapons 
capabilities 

- Current and probable 
locations of enemy 
forces 

- Recent enemy activity 
in the area 

- Any tools necessary 
to annotate, arrange or 
depict information for 
analysis (e.g., acetate, 
map, alcohol pens, 
written order, paper, 
pencil, mission 
command systems) 

COGNITIVE: 

Oral comprehension; 
Written 

comprehension; 

Inductive Reasoning; 
Problem Sensitivity; 
Speed of Closure; 
Memorization 

SENSORY: 

Near Vision 

PSYCHOMOTOR: 

Manual Dexterity, 

Finger Dexterity 

PHYSICAL: 

None 

- Scenario editor allows 
for enemy 
information to be 
included as part of the 
operations order 

*5 - Excellent 

4 - Very Good 

3 - Good 

2 - Fair 

1 - Poor 

Trainee reviews the 
enemy situational 
template 

COGNITIVE: Speed 
of Closure; Inductive 
Reasoning; Deductive 
Reasoning; Problem 
Sensitivity 

- Enemy Situational 
Template 

- Map of operational 
area with appropriate 
graphics and symbols 
represented 

COGNITIVE: Speed 
of Closure; Inductive 
Reasoning; Deductive 
Reasoning; Problem 
Sensitivity 

- Enemy Situational 
template not provided 

5 - Excellent 

4 - Very Good 

3 - Good 

2 - Fair 
*1 - Poor 
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SENSORY: 

Near vision; 

PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity 

PHYSICAL: None 

- Any mission 
command systems 
that are used to assist 
in organizing or 
analyzing enemy 
information 

- See perform terrain 
analysis 

SENSORY: 

Near Vision 

PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity 

PHYSICAL: None 



Trainee considers 

COGNITIVE: 

- Light and weather 

COGNITIVE: 

- Scenario editor allows 

*5 - Excellent 

enemy information in 

Deductive Reasoning; 

data 

Deductive Reasoning; 

for the inclusion of 

4 - Very Good 

conjunction with terrain 

Inductive Reasoning; 

- Information about 

Inductive Reasoning; 

Terrain and Weather 

3 - Good 

and weather data 

Problem Sensitivity; 

terrain and weather 

Problem Sensitivity; 

data as part of the 

2 - Fair 


Speed of Closure; 
Memorization 

SENSORY: 

None 

PSYCHOMOTOR: 

None 

PHYSICAL: 

None 

from previous 
analysis. (See perform 
terrain analysis) 

- Enemy information 
from step 1 (i.e., 
disposition, 
composition, 
suspected locations, 
likely actions) 

Speed of Closure; 
Memorization 

SENSORY: 

None 

PSYCHOMOTOR: 

None 

PHYSICAL: 

None 

battalion operations 
order. 

1 - Poor 

Post-conditions: Trainee has understanding of current enemy situation; Trainee has insight into possible future enemy courses of action 


160 




Score: Very Good 4.00 

Action Item: Perform Terrain Analysis 

Doctrine: FM 5-0, 3-21.10 

Preconditions: Trainee has been issued a mission order and understands his AO and AI; 
Trainee is fa mi liar with troop leading procedures, mission analysis and METT-TC; 
Trainee has conducted steps 1 and 2 of the troop leading procedures 

Task: Conduct a terrain analysis from a map and materials provided by the higher 
headquarters using the acronym OAKOC (Obstacles, Avenues of Approach, Key 
Terrain, Observation and Fields of Fire, Cover and Concealment). 

Post-conditions: Terrain Analysis answers the question; What is the terrain’s effect on 
the operation?; Graphical Display of the Terrain (GDOT) produced 


DEFINITION OF SCALE 

5-Excellent - the TTE contains all but a few (90-100%) of the affordances determined 
during the analysis 

4-Very Good - the ITE contains a significant portion (70-89%) of the affordances 
determined during the analysis 

3-Good - the ITE contains a good portion (50-69%) of the affordances determined 
during the analysis 

2-Fair - the ITE contains some (25-49%) of the affordances determined during the 
analysis 

I-Poor - the ITE contains very few (0-24%) of the affordances determined during the 
analysis 

Evaluation Results: 

FSC’s scenario development tool allows for as much or as little information to be 
provided to the trainee in the form of the operations order. There is no maneuver 
combined obstacle overlay functionality provided in the game. The lack of a MCOO does 
not prohibit the Battalion operations order from providing as much detail as necessary to 
support training this task. FSC does provide several map and simulated picture views of 
the natural and urban terrain for trainees to use during mission planning. 

FSC supports the training of this action item. Overall rating: Very Good 
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Real World (RW) Preconditions: 

Trainee has been issued a mission order and understands his AO and AI; 
Trainee is familiar with troop leading procedures, mission analysis and 
METT-TC; Trainee has conducted steps 1 and 2 of the troop leading 
procedures 

Environment Evaluation 

RW Tasks 

RW Human Abilities 

RW Affordance 
Requirements 

Environment HA 

Environmental 

Affordances 

Level of Support to 
training 

Conduct a terrain 
analysis from a map 
and materials provided 
by the higher 
headquarters using the 
acronym OAKOC 
(Obstacles, Avenues of 
Approach, Key Terrain, 
Observation and Fields 
of Fire, Cover and 
Concealment). 

COGNITIVE: Written 
Comprehension; 
Deductive Reasoning; 
Inductive Reasoning; 
Problem Sensitivity; 
Visualization; Spatial 
Orientation; 
Memorization 

SENSORY: 

Near Vision; Visual 
Color Discrimination; 

PSYCHOMOTOR: 

Arm-Hand Steadiness; 
Manual Dexterity; 

Finger Dexterity; 

PHYSICAL: 

None 

- Paragraph 1 of 

OPORD that provides 
information from 
higher headquarters 
about the terrain and 
weather. 

- Maneuver Combined 
Obstacle Overlay 
from higher 
headquarters 

- Representation of the 
terrain that the trainee 
will maneuver over 
(e.g., map, aerial 
photographs) 

- Intelligence 
information about 
enemy emplaced, 
natural or man-made 
obstacles known by 
the higher 
headquarters 

COGNITIVE: 

SENSORY: 

Near Vision; Visual 
Color Discrimination; 

PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity; 

PHYSICAL: 

None 

- Scenario editor allows 
for as much or as little 
detail as desired in 
paragraph 1 of the 
OPORD. 

- Scenario editor allows 
maps and simulated 
photography to be 
provided in the 
scenario. 

- No MCOO 
functionality exists in 
the game 

5 - Excellent 
*4 - Very Good 

3 - Good 

2 - Fair 

1 - Poor 

Trainee repeats 
analysis as necessary to 
maintain a current 

assessment 






Post-conditions: 

Answer provided to question: What is the terrain’s effect on the operation?; Graphical Terrain Analysis Overlay (GTAO) developed 
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Score: Good 3.00 


Action Item: Conduct an AAR 
Doctrine: TC 25-20; AR 11-13 

Preconditions: Mission or exercise has concluded or been stopped; Type/Format of 
AAR decided. 

Task: Conduct an AAR 

Post-conditions: Trainee has a better understanding of events and how his actions 
influenced mission outcomes. 


DEFINITION OF SCALE 

5-Excellent - the TTE contains all but a few (90-100%) of the affordances determined 
during the analysis 

4-Very Good - the ITE contains a significant portion (70-89%) of the affordances 
determined during the analysis 

3-Good - the ITE contains a good portion (50-69%) of the affordances determined 
during the analysis 

2-Fair - the ITE contains some (25-49%) of the affordances determined during the 
analysis 

I-Poor - the ITE contains very few (0-24%) of the affordances determined during the 
analysis 


Evaluation Comments: 

The game provides the necessary information for the conduct of an AAR but does not 
address the requirement of a facilitator, training objectives and doctrinal references. If 
these are supplied as part of the POI then AARs are fully supported. 

ESC supports this action item. Overall Rating: Good 
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Real World (RW) Preconditions: 

Mission or exercise has concluded or been stopped; Type/Format of AAR 
decided 

Environment Evaluation 

RW Tasks 

RW Human Abilities 

RW Affordance 
Requirements 

Environment HA 

Environmental 

Affordances 

Level of support to 
training 

Conduct an AAR; 

1. During or 
immediately after 
each event 

2. Focus on intended 
training objectives 

3. Focus on soldier, 
leader and unit 
performance 

4. Involve all 
participants in the 
discussion. 

5. Use open-ended 
questions. 

6. Are related to 
specific standards. 

7. Determine strengths 
and weaknesses. 

8. Link performance to 
subsequent training. 

COGNITIVE: 

Oral Expression; Oral 
Comprehension; 
Deductive Reasoning; 
Fluency of Ideas; 
Inductive Reasoning; 
Problem Sensitivity; 
Information Ordering; 
Visualization; Speed of 
Closure; Perceptual 
Speed 

SENSORY: 

Near Vision; Visual 
Color Discrimination; 
Speech Clarity; Speech 
Recognition; 

PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity; 
Reaction Time; 

PHYSICAL; Stamina; 
Gross Body 

Equilibrium 

- A way to identify, 
recreate or represent 
significant events that 
occurred during 
training 

- Representation or 
replication of trainee 
performance at 
identified key points 
in training 

- A Eacilitator 

- Training Audience 

- Training Objectives 

- Doctrinal 
references/info 

COGNITIVE: 

Inductive Reasoning; 
Problem Sensitivity; 
Information Ordering; 
Speed of Closure; 
Perceptual Speed 

SENSORY: 

Near Vision; Visual 
Color Discrimination; 

PSYCHOMOTOR: 

Manual Dexterity; 

Einger Dexterity; 

PHYSICAL: 

None 

- Recording of mission 

- Statistics dealing with 
weapon use (e.g., 
mortars, grenade, 
satchel charges and 
javelins) 

- Weapon distributions 
and ammo 
expenditure 

- Casualties 

- Blue force plan 

OPORD 

- Red force plan 

- Review screen that 
allows players to view 
operation and stop at 
decision points to 
view specific events 

- Explainable AI that 
allows preformatted 
questions to be asked 
of Soldiers to 
determine what was 
going on at that time. 

5 - Excellent 

4 - Very Good 
*3 - Good 

2 - Eair 

1 - Poor 

Post-conditions: 

Trainee has a better understanding of events and how his actions influenced mission outcomes. 
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Score: Good 3.45 


Action Item(s): 

Synchronize a light company team attack in an urban operation 
Synchronize the engineer portion of a light infantry company attack 
Synchronize the indirect fires portion of a light infantry company attack 

Doctrine: FM 3-21.10 

Preconditions: Trainee has received a mission order; Trainee has knowledge of doctrine 
dealing with offensive and urban operations; Trainee has knowledge about how to plan 
indirect fires and breaching operations. 

Task (s): 

1. Integrate the following to develop a course of action: 

Apply selected steps of the Troop Leading Procedures (Partially Evaluated) 
Conduct Mission Analysis (Partially evaluated) 

Analyze civil considerations (Evaluated) 

Analyze enemy situation (Evaluated) 

Perform terrain analysis (Evaluated) 

Develop a course of action for a light infantry company (Evaluated) 

Conduct Reconnaissance (Evaluated) 

Determine own force potential (Evaluated) 

Integrate the fundamentals of the offense into a COA (Evaluated) 

Integrate fire support into urban operations (Evaluated) 

Plan breaching operations (Evaluated) 

Select a COA (Evaluated) 

Issue a ERA GO (Evaluated) 

2. Command and control the execution of the plan. 

Post-conditions: Plan is developed and actions are synchronized; Plan is executed and 
adjustments are made based on changing battlefield conditions 
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DEFINITION OF SCALE 


5-Excellent - the ITE contains all but a few (90-100%) of the affordances determined 
during the analysis 

4-Very Good - the ITE contains a significant portion (70-89%) of the affordances 
determined during the analysis 

3-Good - the ITE contains a good portion (50-69%) of the affordances determined 
during the analysis 

2-Fair - the ITE contains some (25-49%) of the affordances determined during the 
analysis 

I-Poor - the ITE contains very few (0-24%) of the affordances determined during the 
analysis 


Evaluation Results: 

ESC enables a trainee to think through and develop a plan for several operational 
scenarios. As a part of the planning process trainees are required to execute the cognitive 
actions required to synchronize plans for success. During the execution of the plans 
developed, trainees must react to unplanned/unforeseen situations and synchronize the 
effects of several combat multipliers. While the actions of command and control are 
limited ESC does afford a trainee the opportunity to practice synchronization actions. 

ESC supports the training of this action item. Overall rating: Good 
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Real World (RW) Preconditions: 

Trainee has received a mission order; Trainee has knowledge of doctrine 
dealing with offensive and urban operations; Trainee has knowledge about 
how to plan indirect fires and breaching operations 

Environment Evaluation 

RW Tasks 

RW Human Abilities 

RW Affordance 
Requirements 

Environment HA 

Environmental 

Affordances 

Level of Support to 
Training 

Apply selected troop 
leading procedures 

See apply selected 
troop leading 
procedures 

See apply selected 
troop leading 
procedures 

See apply selected 
troop leading 
procedures 

See apply selected 
troop leading 
procedures 

5 - Excellent 

4 - Very Good 
*3 - Good 

2 - Fair 

1 - Poor 

Conduct Mission 

Analysis 

See conduct mission 
analysis 

See conduct mission 
analysis 

See conduct mission 
analysis 

See conduct mission 
analysis 

5 - Excellent 

4 - Very Good 
*3 - Good 

2 - Fair 

1 - Poor 

Analyze civil 
considerations 

See analyze civil 
considerations 

See analyze civil 
considerations 

See analyze civil 
considerations 

See analyze civil 
considerations 

5 - Excellent 

4 - Very Good 

3 - Good 
*2 - Fair 

1 - Poor 

Analyze enemy 
situation 

See analyze enemy 
situation 

See analyze enemy 
situation 

See analyze enemy 
situation 

See analyze enemy 
situation 

5 - Excellent 
*4 - Very Good 

3 - Good 

2 - Fair 

1 - Poor 

Perform terrain analysis 

See perform terrain 
analysis 

See perform terrain 
analysis 

See perform terrain 
analysis 

See perform terrain 
analysis 

5 - Excellent 
*4 - Very Good 

3 - Good 

2 - Fair 

1 - Poor 

Develop a course of 
action for a light 
infantry company 

See develop a light 
infantry company 
course of action 

See develop a light 
infantry company 
course of action 

See develop a light 
infantry company 
course of action 

See develop a light 
infantry company 
course of action 

5 - Excellent 

4 - Very Good 
*3 - Good 

2 - Fair 

1 - Poor 

Conduct 

See conduct 

See conduct 

See conduct 

See conduct 

5 - Excellent 
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Reconnaissance 

reconnaissance 

reconnaissance 

reconnaissance 

reconnaissance 

4 - Very Good 
*3 - Good 

2 - Fair 

1 - Poor 

Determine own force 
potential 

See determine own 
force potential combat 
power 

See determine own 
force potential combat 
power 

See determine own 
force potential combat 
power 

See determine own 
force potential combat 
power 

*5 - Excellent 

4 - Very Good 

3 - Good 

2 - Fair 

1 - Poor 

Integrate the 
fundamentals of the 
offense into a COA 

See integrate the 
fundamentals of the 
offense into a COA 

See integrate the 
fundamentals of the 
offense into a COA 

See integrate the 
fundamentals of the 
offense into a COA 

See integrate the 
fundamentals of the 
offense into a COA 

5 - Excellent 

4 - Very Good 
*3 - Good 

2 - Fair 

1 - Poor 

Integrate fire support 
into urban operations 

See integrate fire 
support into urban 
operations 

See integrate fire 
support into urban 
operations 

See integrate fire 
support into urban 
operations 

See integrate fire 
support into urban 
operations 

5 - Excellent 
*4 - Very Good 

3 - Good 

2 - Fair 

1 - Poor 

Plan breaching 
operations 

See plan breaching 
operations 

See plan breaching 
operations 

See plan breaching 
operations 

See plan breaching 
operations 

5 - Excellent 
*4 - Very Good 

3 - Good 

2 - Fair 

1 - Poor 

Select a COA 

See select a course of 
action 

See select a course of 
action 

See select a course of 
action 

See select a course of 
action 

5 - Excellent 

4 - Very Good 
*3 - Good 

2 - Fair 

1 - Poor 

Issue a FRAGO 

See issue a FRAGO 

See issue a FRAGO 

See issue a FRAGO 

See issue a FRAGO 

5 - Excellent 
*4 - Very Good 

3 - Good 

2 - Fair 

1 - Poor 

Command and Control 
Execution (Supervise) 

COGNITIVE: 

Oral Expression; Oral 
Comprehension; 

- Elements to command 
and a tactical scenario 
in which to control 

COGNITIVE: 

Oral Comprehension; 
Written 

- AI Unit 

- Higher HQ 

*5 - Excellent 

4 - Very Good 

3 - Good 
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Written 

Comprehension; 
Deductive Reasoning; 
Fluency of Ideas; 
Inductive Reasoning; 
Originality; Problem 
Sensitivity; Information 
Ordering; Mathematical 
Reasoning; 
Visualization; Spatial 
Orientation; Speed of 
Closure; Perceptual 
Speed; Memorization; 
Selective Attention; 
Time Sharing; 

SENSORY: 

Night Vision; 

Peripheral Vision; 

Glare Sensitivity; 

Depth Perception; Far 
Vision; Near Vision; 
Visual Color 
Discrimination; 
Auditory Attention; 
Speech Clarity; Speech 
Recognition; Hearing 
Sensitivity; Sound 
Localization; 


them. 

Scenario providing 
representations of the 
higher commander, 
the enemy, the 
physical environment 
and the enemy. 

The environment 
should afford radio 
communications 
between the trainee, 
his unit elements and 
his higher 
headquarters. 

The environment 
should afford 
interaction between 
the trainee, his 
subordinate elements, 
his higher 

headquarters and the 
enemy. 

Environment should 
afford the trainee a 
way to adjust his plan 
and issue new orders 
during the scenario as 
in real life. 


PSYCHOMOTOR: 

Arm-Hand Steadiness; 
Manual Dexterity; 
Finger Dexterity; 
Control Precision; 
Response Orientation; 
Rate Control; 


Comprehension; - Game acts as mission 2 - Fair 

Deductive Reasoning; command system 1 - Poor 

Inductive Reasoning; during execution 

Problem Sensitivity; - Tactical scenario 

Information Ordering; _ Interaction through 

Visualization; Spatial scripted messages. 

Orientation; Speed of simulated radio traffic 

Closure; Memorization; and FRAGO orders 

Time Sharing; _ pRAGO capability 

SENSORY: 

Near Vision; Visual 
Color Discrimination 

PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity; 

PHYSICAL: 

None 





Multilimb 

Coordination; 

PHYSICAL: 

Explosive Strength; 
Trunk Strength; 

Stamina; Extent 
Elexibility; Gross Body 
Coordination; Gross 

Body Equilibrium 





Post-conditions: 

Plan is developed and actions are synchronized; Plan is executed and adjustments are made based on changing battlefield conditions 
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Score: Excellent 5.00 


Action Item: Determine own force potential combat power 
Doctrine: FM 3-21.10 

Preconditions: Trainees receive a mission order and a task organization for execution of 
the mission for their unit. 

Task: Determine force combat power: Identify all available organic and non-organic unit 
assets available to determine the unit’s strength, composition and capabilities. 

Post-conditions: Trainees have an understanding of the composition, strength and 
capabilities of all assets available to them for their assigned mission. 


DEFINITION OF SCALE 

5-Excellent - the TTE contains all but a few (90-100%) of the affordances determined 
during the analysis 

4-Very Good - the ITE contains a significant portion (70-89%) of the affordances 
determined during the analysis 

3-Good - the ITE contains a good portion (50-69%) of the affordances determined 
during the analysis 

2-Fair - the ITE contains some (25-49%) of the affordances determined during the 
analysis 

I-Poor - the ITE contains very few (0-24%) of the affordances determined during the 
analysis 

Evaluation Comments: 

The scenario-editing tool allows the trainer to increase or decrease the amount of detail 
provided to the trainee as part of the operations order process. The trainee is not able to 
ascertain the strengths and weaknesses of unit personnel or weapons systems. ESC 
provides information about task organization, composition and available assets of unit 
elements. While it is possible to specify the percentage of capability of a unit, an 
assumption that is made is that the unit is lOOpercent capable given the task organization 
present and that any augmentation of the unit is provided at lOOpercent of its capability 
as well. 

ESC supports this action item. Overall rating: Excellent 
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Real World (RW) Preconditions: 

Trainee receives a mission order and a task organization for execution of the 
mission for his unit. 

Environmental Evaluation 

RW Tasks 

RW Human Abilities 

RW Affordance 
Requirements 

Environment HA 

Environmental 

Affordances 

Level of support to 
training 

Trainees identify all 
available organic and 
non-organic assets 
available to them to 
determine their unit’s 
strength, composition 
and capabilities. 

COGNITIVE: 

Written 

Comprehension; Oral 
Comprehension; 
Inductive Reasoning; 
Problem Sensitivity; 
Mathematical 

Reasoning; 

Visualization; 

Perceptual Speed; 
Memorization; 

SENSORY: 

Near Vision; Speech 
Recognition 

PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity; 

PHYSICAL: 

None 

- Information about 
available assets for the 
trainee to use to 
accomplish his 
mission. 

- Information about 
strengths and 
weaknesses of unit 
equipment and 
personnel. 

- Friendly weapons 
capabilities, status and 
number 

- Tools that assist the 
trainee in annotating, 
arranging or depicting 
own unit information 
for analysis (e.g., 
acetate, map, alcohol 
pens, written order, 
paper, pencil, 
computer screens) 

COGNITIVE: 

Written 

Comprehension; 
Inductive Reasoning; 
Problem Sensitivity; 
Mathematical 

Reasoning; 

Memorization; 

SENSORY: 

Near Vision; 

PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity; 

PHYSICAL: 

None 

- Task organization for 
trainee’s unit 

- Notification of 
additional assets 
provided to support 
trainee 

- Scenario editor that 
allows the trainer to 
increase or decrease 
the amount of 
information about the 
unit or attachments 
depending on the 
intent of the training. 

*5 - Excellent 

4 - Very Good 

3 - Good 

2 - Fair 

1 - Poor 

Post-conditions: 

Trainee has an understanding of the composition, strength and capabilities of all assets available to him for his assigned mission. 
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Score: GOOD 3.00 


Action Item: Select a Course of Action (COA) 

Doctrine: FM 3-21.10, 5-0 

Preconditions: Trainee is familiar with the troop leading procedures; Trainee is familiar 
with the execution of mission analysis and course of action development; Trainee has 
developed at least 2 courses of action; All courses of action have been evaluated for their 
suitability, completeness, feasibility, distinctness and completeness. 

Task: Select a COA that meets the requirements of the battalion commander's intent, 
achieves the company's purpose, maximizes the effects of terrain, minimizes casualties, 
and is within the company's capabilities. 

Post-conditions: Best COA is selected from available alternatives that satisfies the need 
and operational conditions 

DEFINITION OF SCALE 

5-Excellent - the TTE contains all but a few (90-100%) of the affordances determined 
during the analysis 

4-Very Good - the ITE contains a significant portion (70-89%) of the affordances 
determined during the analysis 

3-Good - the ITE contains a good portion (50-69%) of the affordances determined 
during the analysis 

2-Fair - the ITE contains some (25-49%) of the affordances determined during the 
analysis 

I-Poor - the ITE contains very few (0-24%) of the affordances determined during the 
analysis 

**Note: EM 3-21.10 states that at the company level only one COA is usually generated. 
At higher levels more that one course of action is developed and compared making the 
selection process a more formal one. 

Evaluation Results: 

ESC does not have the ability to develop multiple courses of action for possible 
employment and further ESC does not separate COA development from OPORD 
development. As noted above, doctrine accepts the generation and implementation of 
only one COA as part of the mission analysis process at the company level. While we 
believe that the merging of COA development and OPORD development does not result 
in negative training, it violates doctrinal guidance concerning the development, 
wargaming and selection of a COA. 

ESC does not support the training of this action item. Overall Rating: Good 
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Real World (RW) Preconditions: Trainee is familiar with the troop leading 
procedures; Trainee is familiar with the execution of mission analysis and 
course of action development; Trainee has developed at least 2 courses of 
action; All courses of action have been evaluated for their suitability, 
completeness, feasibility, distinctness and completeness 

Environment Evaluation 

System allows for the development of only 1 COA that is the operations order 
that is issued to the unit. 

Tasks 

Human Abilities 

Affordance 

Requirements 

Environment HA 

Environmental 

Affordances 

Level of Support to 
training 

Select a course of action 

COGNITIVE: 

Deductive Reasoning; 
Problem Sensitivity 

SENSORY: 

Near Vision 

PSYCHOMOTOR: 

None 

PHYSICAL: 

None 

- A course of action that 
has been developed. 

- A means to physically 
select or annotate 
selection of one COA 

COGNITIVE: 

Deductive Reasoning; 
Problem Sensitivity 

SENSORY: 

Near Vision 

PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity 

PHYSICAL: 

None 

- The ability to develop 
an operations order 
that contains a course 
of action that is issued 
to the unit for 
execution. 

5 - Excellent 

4 - Very Good 
*3 - Good 

2 - Fair 

1 - Poor 

**This item should be 
rated as Poor because 
the system does not 
allow the development 
and selection of a COA 
separate from the 
development of the 
operations order. 

Post-conditions: Best COA is selected from available alternatives that satisfies the need and operational conditions 
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Score: Good 3.25 


Action Item: Apply Selected Troop Leading Procedures 
Doctrine: FM 3-21.10, 5-0 

Preconditions: Headquarters has issued a mission type order. 


Tasks: 

1. Receive the mission and conduct analysis of its contents 

2. Issue a warning order to unit to allow them to begin parallel planning 

3. Make a tentative Plan that will be the basis for the OPORD 

4. Initiate movement of unit elements so that they may be prepared for initiation of the 
mission 

5. Reconnoiter in support of plan development 

6. Complete the plan and develop the OPORD 

7. Issue OPORD 

8. Supervise execution of OPORD 

Post-conditions: Trainee understands higher commanders mission and intent; Trainee 
understands the threat and higher commanders CCIR; Trainee develops a plan for his unit 
that has taken account of specified, implied and critical tasks necessary to fulfill the 
higher headquarters mission; Trainee issues his mission order to his unit elements and 
controls it’s execution; Trainee exercises command. 

DEFINITION OF SCALE 

5-Excellent - the TTE contains all but a few (90-100%) of the affordances determined 
during the analysis 

4-Very Good - the ITE contains a significant portion (70-89%) of the affordances 
determined during the analysis 

3-Good - the ITE contains a good portion (50-69%) of the affordances determined 
during the analysis 

2-Fair - the ITE contains some (25-49%) of the affordances determined during the 
analysis 

I-Poor - the ITE contains very few (0-24%) of the affordances determined during the 
analysis 
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Evaluation Comments: 


Each scenario within ESC initially provides the trainee with a BN mission using the 5- 
paragraph format. ESC does not allow the trainee to develop or issue warning orders. 
Initiation mission time prior to order issuance is possible but only allows the opposing 
force to initiate movement prior to order execution. The ability to conduct reconnaissance 
is limited to map reconnaissance using the provided map and imagery that exists as part 
of the scenario. Trainee developed operations orders are matrix style graphical templates 
not the standard 5-paragraph field order. The actions of making a tentative plan and 
completing the plan are executed as one step when the trainee puts together his operations 
order for the mission. Supervision is conducted by monitoring the activities of forces via 
radio and visual means as an avatar on the field of battle. 

The analysis of this action item supports the assertion that applying select troop leading 
procedures is possible. 

ESC supports training this action item. Overall rating: Good 


176 



Real World (RW) Preconditions: Higher Headquarters has issued a mission 
type order 

Environment Evaluation 

Tasks 

Human Abilities 

Affordance 

Requirements 

Environment HA 

Environmental 

Affordances 

Level of Support to 
training 

Receive the mission 
and conduct analysis of 
its contents 

COGNITIVE: 

Oral Comprehension; 
Written 

Comprehension; 
Deductive Reasoning; 
Inductive Reasoning; 
Visualization; Spatial 
Orientation; Selective 
Attention; Time 

Sharing; 

SENSORY: 

Near Vision; Auditory 
Attention 

PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity 

PHYSICAL: 

None 

- Higher headquarters 
mission and 
commanders intent 

- See assess enemy 
situation 

- See perform terrain 
analysis 

- See determine own 
force potential combat 
power 

- A means to develop a 
timeline and keep 
track of time available 
for planning 

COGNITIVE: 

Written 

Comprehension; 
Deductive Reasoning; 
Inductive Reasoning; 
Visualization; Spatial 
Orientation 

SENSORY: 

Near Vision 

PSYCHOMOTOR: 

Manual Dexterity; 

Einger Dexterity 

PHYSICAL: 

None 

- System scenario 
development tool 
allows for as much or 
as little information 
about the mission to 
be provided to the 
trainee. 

- System provides the 
option of changing the 
amount of available 
time to complete the 
mission but does not 
have a timeline tool or 
representation 

5 - Excellent 
*4 - Very Good 

3 - Good 

2 - Eair 

1 - Poor 

Issue a warning order to 
unit to allow them to 
begin parallel planning 

COGNITIVE: 

Oral Expression; 

Written Expression; 

SENSORY: 

Near Vision; Speech 
Clarity; 

PSYCHOMOTOR: 

Manual Dexterity; 

Einger Dexterity; 

- Audience to issue 
order too 

- Ability to develop a 
warning order 

- Warning order format 

- A means of 
transferring the 
information to the 
audience if other than 
verbally (e.g., mission 
command system). 

COGNITIVE: 

None 

SENSORY: 

Near Vision 

PSYCHOMOTOR: 

Manual Dexterity; 

Einger Dexterity 

PHYSICAL: 

None 

- Audience of 
artificially intelligent 
avatars that execute 
instructions 

- A way to transmit the 
order 

- No warning order 
functionality present 
in the game. 

5 - Excellent 

4 - Very Good 
*3 - Good 

2 - Eair 

1 - Poor 

**This item would be 
rated as Poor if tasks 
were not considered 
equally important. Not 
having a warning order 
to issue makes this task 
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PHYSICAL: 

None 




un trainable. 

Make a tentative Plan 

COGNITIVE: 

- See develop a light 

COGNITIVE: 

- See develop a light 

5 - Excellent 

that will be the basis for 

Written 

infantry COA 

Written 

infantry COA 

4 - Very Good 

the OPORD 

Comprehension; 

- See conduct mission 

Comprehension; 

- See conduct mission 

*3 - Good 


Written Expression; 

analysis 

Deductive Reasoning; 

analysis 

2 - Fair 


Deductive Reasoning; 


Inductive Reasoning; 


1 - Poor 


Fluency of Ideas; 


Originality; Problem 




Inductive Reasoning; 


Sensitivity; Information 




Originality; Problem 


Ordering; 




Sensitivity; Information 


Visualization; Speed of 




Ordering; Mathematical 


Closure; Memorization; 




Reasoning; Number 
Facility; Visualization; 


Time Sharing; 




Spatial Orientation; 


SENSORY: 




Speed of Closure; 
Perceptual Speed; 


Near Vision; 




Memorization; 


PSYCHOMOTOR: 




Selective Attention; 


Manual Dexterity; 




Time Sharing; 


Finger Dexterity; 




SENSORY: 


PHYSICAL: 




Near Vision; 


None 




PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity; 






PHYSICAL: None 





Initiate movement of 

COGNITIVE: 

- Environment must 

COGNITIVE: 

- Settings within the 

5 - Excellent 

unit elements so that 

Oral Expression; 

provide the trainee the 

Written Expression; 

scenario allow the 

4 - Very Good 

they may be prepared 

Written Expression; 

ability to initiate 

Problem Sensitivity; 

opposing force to 

3 - Good 

the mission 

Problem Sensitivity; 

movement of his 


move during planning 

*2 - Fair 


Spatial Orientation; 

forces in preparation 

SENSORY: 

but not friendly forces 

1 - Poor 



for plan execution 

Near Vision 

- No WARNO 



SENSORY: 

prior to OPORD 


capability 



Speech Clarity; 

issuance (e.g., move 

PSYCHOMOTOR: 

- Game acts as mission 
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PSYCHOMOTOR: 

Arm-Hand Steadiness; 
Manual Dexterity; 

Finger Dexterity; 

PHYSICAL: 

Dynamic Strength; 

Extent Flexibility; 

Gross Body 

Coordination; Gross 

Body Equilibrium 

vehicles to staging 
point, conduct 
reconnaissance, 
conduct rehearsals) 

- Ability to develop 
Warning type orders 

- A means to transmit 
orders (e.g., mission 
command system, 
radio) 

Manual Dexterity; 

Finger Dexterity; 

PHYSICAL: 

None 

command system 


Reconnoiter in support 
of plan development 

- See Conduct 
Reconnaissance 

- See Conduct 
Reconnaissance 

- See Conduct 
Reconnaissance 

- See Conduct 
Reconnaissance 

5 - Excellent 

4 - Very Good 
*3 - Good 

2 - Fair 

1 - Poor 

Complete the plan and 
develop the OPORD 

COGNITIVE: 

Oral Comprehension; 
Written Expression; 
Deductive Reasoning; 
Inductive Reasoning; 
Originality; Problem 
Sensitivity; Information 
Ordering; Mathematical 
Reasoning; 

Visualization; Spatial 
Orientation; Speed of 
Closure; Perceptual 
Speed; Memorization; 
Selective Attention; 

Time Sharing; 

SENSORY: 

Near Vision; Auditory 
Attention; Speech 
Recognition; 

- See assess civil 
considerations 

- Outputs or pieces of 
necessary information 
from previous steps of 
the mission analysis 
and troop leading 
processes 

- Pieces of the 
operations order or 
plan that are to be 
combined together to 
make up the plan of 
action 

COGNITIVE: 

Written Expression; 
Deductive Reasoning; 
Inductive Reasoning; 
Originality; Problem 
Sensitivity; Information 
Ordering; 

Visualization; Speed of 
Closure; Memorization; 
Time Sharing; 

SENSORY: 

Near Vision; 

PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity; 

PHYSICAL: 

None 

- See assess civil 
considerations 

- Higher HQ OPORD 
and intelligence 
information 

5 - Excellent 

4 - Very Good 
*3 - Good 

2 - Fair 

1 - Poor 
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PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity; 

PHYSICAL: 

None 





Issue OPORD 

COGNITIVE: 

Oral Expression; 

Written Expression; 

SENSORY: 

Near Vision; Speech 
Recognition; 

PSYCHOMOTOR: 

Manual Dexterity; 

Einger Dexterity; 

PHYSICAL: None 

- See issue infantry 
company or company- 
team operations order 

COGNITIVE: 

Written Expression 

SENSORY: 

Near Vision; 

PSYCHOMOTOR: 

Manual Dexterity; 

Einger Dexterity; 

PHYSICAL: None 

- See issue infantry 
company or company- 
team operations order 

5 - Excellent 

4 - Very Good 
*3 - Good 

2 - Eair 

1 - Poor 

Supervise execution of 
the OPORD 

COGNITIVE: 

Oral Expression; Oral 
Comprehension; 

Written 

Comprehension; 
Deductive Reasoning; 
Eluency of Ideas; 
Inductive Reasoning; 
Originality; Problem 
Sensitivity; Information 
Ordering; Mathematical 
Reasoning; 

Visualization; Spatial 
Orientation; Speed of 
Closure; Perceptual 
Speed; Memorization; 
Selective Attention; 

- Elements to command 
and a tactical scenario 
in which to control 
them. 

- Any mission 
command systems 
available and 
normally used in the 
act of commanding or 
controlling a tactical 
plan 

- Scenario providing 
representations of the 
higher commander, 
the enemy, the 
physical environment 
and the enemy. 

COGNITIVE: 

Oral Comprehension; 
Written 

Comprehension; 
Deductive Reasoning; 
Inductive Reasoning; 
Problem Sensitivity; 
Information Ordering; 
Visualization; Spatial 
Orientation; Speed of 
Closure; Memorization; 
Time Sharing; 

SENSORY: 

Near Vision; Visual 

Color Discrimination 

- AI Unit 

- Higher HQ 

- Game acts as mission 
command system 
during execution 

- Tactical scenario 

- Interaction through 
scripted messages, 
simulated radio traffic 
and ERAGO orders 

- ERAGO capability 

*5 - Excellent 

4 - Very Good 

3 - Good 

2 - Eair 

1 - Poor 
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Time Sharing; 

- The environment 

PSYCHOMOTOR: 



should provide a way 

Manual Dexterity; 


SENSORY: 

for the trainee to 

Einger Dexterity; 


Night Vision; 

interact with his 



Peripheral Vision; 

subordinate elements, 

PHYSICAL: 


Glare Sensitivity; 

his higher 

None 


Depth Perception; Far 

headquarters and the 



Vision; Near Vision; 

enemy (i.e.. 



Visual Color 

communicate, signal. 



Discrimination; 

attack, etc.) 



Auditory Attention; 

- Environment should 



Speech Clarity; Speech 

provide a means for 



Recognition; Hearing 

the trainee a way to 



Sensitivity; Sound 

adjust his plan and 



Localization; 

issue new orders 
during the scenario as 



PSYCHOMOTOR: 

in real life (See issue a 



Arm-Hand Steadiness; 
Manual Dexterity; 

Finger Dexterity; 

Control Precision; 
Response Orientation; 
Rate Control; 

Multilimb 

Coordination; 

ERAGO) 



PHYSICAL: 

Explosive Strength; 
Trunk Strength; 

Stamina; Extent 
Elexibility; Gross Body 
Coordination; Gross 

Body Equilibrium 





Post-conditions: Trainee understands higher commanders mission and intent; Trainee understands the threat and higher commanders CCIR; Trainee develops 
a plan for his unit that has taken account of specified, implied and critical tasks necessary to fulfill the higher headquarters mission; Trainee issues his mission 
order to his unit elements and controls it’s execution; Trainee exercises command 
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Score: Fair 2.00 


Action Item: Assess Civil Considerations 
Doctrine: FM 3-24, 3-34, 5-0 
Preconditions: 

1. Trainee is familiar with doctrinal description of assessment (FM 5-0) 

• Gather tools and assessment data. 

• Understand current and desired conditions. 

• Develop assessment measures and potential indicators. 

• Develop the collection plan. 

• Assign responsibilities for conducting analysis and generating 
recommendations. 

• Identify feedback mechanisms. 

2. Trainee has knowledge and understanding about civil considerations: The 
influence of manmade infrastructure, civilian institutions, and attitudes 
and activities of the civilian leaders, populations, and organizations within 
an AO on the conduct of military operations (FM 6-0). 

3. Trainee receives current information regarding important civil 
considerations in his area of operations. 

Tasks: 

1. Trainee develops or adopts an existing assessment mechanism to 
categorize civil considerations (e.g., SWEAT [sewage, water, electricity, 
academics, trash] or ASCOPE [areas, structures, capabilities, 
organizations, people, events]) 

2. Trainee gathers and processes all available information about the civil 
considerations in his AO. 

3. Trainee assigns a quantitative or qualitative value to each piece of the 
assessment mechanism based on 1. 

4. Trainee monitors status of the conditions on the ground and updates his 
assessment (repeat steps 1-3) as necessary. 

Post-conditions: Trainee is familiar with the important civil considerations within his 
AO; Trainee has increased proficiency in assessing the impact of civil considerations on 
military operations. 
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DEFINITION OF SCALE 


5-Excellent - the ITE contains all but a few (90-100%) of the affordances determined 
during the analysis 

4-Very Good - the ITE contains a significant portion (70-89%) of the affordances 
determined during the analysis 

3-Good - the ITE contains a good portion (50-69%) of the affordances determined 
during the analysis 

2-Fair - the ITE contains some (25-49%) of the affordances determined during the 
analysis 

I-Poor - the ITE contains very few (0-24%) of the affordances determined during the 
analysis 

Evaluation Comments: 

No information about the civilian population relevant to civil considerations was 
provided in any of the scenarios provided with the game. The scenario editor allows for 
information to be added into the BN OPORD as necessary. The game itself acts as a 
default mission command (MC) system but does not contain any way for the trainee to 
build an assessment mechanism. The game does not include any structured or 
preformatted assessment mechanism for trainee use. 

ESC supports training this action item. Overall Rating: Fair 


183 



Real World (RW) Preconditions: Trainee is familiar with doctrinal 
description of assessment (FM 5-0); Trainee has knowledge and 
understanding about civil considerations; Trainee receives current 
information regarding important civil considerations in his AO. 

Environment Evaluation 

No information concerning civil considerations within the AO is provided to 
the Trainee by the game or the scenarios violating this necessary 
precondition. 

RW Tasks 

RW Human Abilities 

RW Affordance 
Requirements 

Environment HA 

Environmental 

Affordances 

Level of Support to 
Training 

Trainee develops or 
adopts an existing 
assessment mechanism 
to categorize civil 
considerations. 

COGNITIVE: 

Written Expression; 

Oral Expression; 

Eluency of Ideas; Speed 
of Closure; Inductive 
Reasoning; Deductive 
Reasoning; Problem 
Sensitivity; Originality; 
Category Elexibility; 
Memorization 

SENSORY: 

Near vision; 

PSYCHOMOTOR: 

Manual Dexterity; 

Einger Dexterity 

PHYSICAL: 

None 

- Example assessment 
mechanism 

- Tools to develop an 
assessment 
mechanism (e.g., 
mission command 
systems, pens, paper, 
etc.) 

- Way to visualize 
assessment 

COGNITIVE: 

Eluency of Ideas; Speed 
of Closure; Inductive 
Reasoning; Deductive 
Reasoning; Problem 
Sensitivity; Originality; 
Category Elexibility; 
Memorization 

SENSORY: 

Near Vision 

PSYCHOMOTOR: 

Manual Dexterity; 

Einger Dexterity 

PHYSICAL: 

None 

- None 

5 - Excellent 

4 - Very Good 

3 - Good 

2 - Eair 
*1 - Poor 

Trainee gathers and 
processes all available 
information about the 
civil considerations in 
his AO. 

COGNITIVE: Oral 
comprehension; Written 
comprehension; 

Inductive Reasoning; 
Problem Sensitivity; 
Information Ordering; 
Speed of Closure 

SENSORY: Near 

Vision 

- Information about the 
civilian population, 
government and urban 
landscape. 

- Known friction points 
between civilian 
population and 
friendly forces 

- Known problems 
within the civilian 

COGNITIVE: 

Written 

Comprehension; 
Inductive reasoning; 
Problem Sensitivity 

SENSORY: 

Near Vision 

PSYCHOMOTOR: 

Manual Dexterity; 

- Scenario editor 
provides the ability to 
have as much or as 
little information 
about the population 
as desired. This 
information would 
come from the BN 
OPORD. 

- System does not 
provide any way to 

*5 - Excellent 

4 - Very Good 

3 - Good 

2 - Eair 

1 - Poor 
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PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity 

PHYSICAL: None 

population (e.g., 
fighting over oil 
rights) 

- Tools to annotate, 
arrange or depict 
information for 
analysis (e.g., mission 
command systems, 
acetate, map, alcohol 
pens, written order, 
paper, pencil, 
computer screens) 

Finger Dexterity 

PHYSICAL: 

None 

develop or annotate an 
assessment 

mechanism 


Trainee assigns a 
quantitative or 
qualitative value to 
each piece of the 
assessment mechanism 
based on 1. 

COGNITIVE: 

Mathematical 

Reasoning; Number 
Facility; Inductive 
Reasoning; Deductive 
Reasoning 

SENSORY: 

Near Vision; 

PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity 

PHYSICAL: 

None 

- Tools to mark or 
annotate the 

assessment 

mechanism 

- Assessment 
mechanism 

- Way to visualize the 
assessment 
mechanism (e.g., 
mission command 
system) 

COGNITIVE: 

None 

SENSORY: 

Near Vision 

PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity 

PHYSICAL: 

None 

- None 

5 - Excellent 

4 - Very Good 

3 - Good 

2 - Fair 
*1 - Poor 

Trainee monitors status 
of the conditions on the 
ground and updates his 
assessment (repeat 
steps 1-3) as necessary. 

COGNITIVE: 

Oral Comprehension; 
Written 

Comprehension; 
Deductive Reasoning; 
Inductive Reasoning; 
Problem Sensitivity; 
Speed of Closure; 
Memorization; 

- Information about 
civil conditions in the 
area of operations that 
stimulate the use of an 

assessment 
mechanism or impact 
ongoing operations 
that the trainee must 

react to. 

COGNITIVE: 

Oral Comprehension; 
Written 

Comprehension; 
Deductive Reasoning; 
Inductive Reasoning; 
Problem Sensitivity; 
Speed of Closure; 
Memorization 

- None 

5 - Excellent 

4 - Very Good 

3 - Good 

2 - Eair 
*1 - Poor 
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SENSORY: 

- Mission command 

SENSORY: 


Peripheral Vision; 

system if used and 

Near Vision 


Depth Perception; Far 

available 



Vision; Near Vision; 


PSYCHOMOTOR: 


Speech Recognition; 


None 


PSYCHOMOTOR: 


PHYSICAL: 


None 


None 


PHYSICAL: 




None 





Post-conditions: Trainee is familiar with the important civil considerations within his AO; Trainee has increased proficiency in assessing the impact of civil 
considerations on military operations. 
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Score: Good 3.28 


Action Item: Integrate fundamentals and techniques of the offense into a COA 
Doctrine: FM 3-21.10, 5-0 

Preconditions: Trainee has understands the fundamentals of offensive operations 
(Surprise, Concentration, Audacity, Tempo, Flexibility); Trainee has been issued a 
mission order that directs his element to conduct an offensive operation; Trainee is 
familiar with the techniques of offensive operations (Movement to Contact, Attack, 
Exploitation, Pursuit) 


Task: Develop an offensive COA 

1. Identify the necessary offensive technique for the specified mission (Movement to 
Contact, Attack, Exploitation, Pursuit) 

2. Analyze relative combat power (strengths and weaknesses) 

3. Generate options that incorporate the fundamentals of offensive operations and 
offensive technique 

4. Array the forces available 

5. Develop an offensive concept of the operation 

6. Assign responsibilities 

7. Prepare a COA statement and sketch 

Post-conditions: COA is developed that incorporates the fundamentals of the offense 
appropriately and meets the criteria of being suitable, acceptable, feasible, distinguishable 
and complete. 


DEFINITION OF SCALE 

5-Excellent - the TTE contains all but a few (90-100%) of the affordances determined 
during the analysis 

4-Very Good - the ITE contains a significant portion (70-89%) of the affordances 
determined during the analysis 

3-Good - the ITE contains a good portion (50-69%) of the affordances determined 
during the analysis 

2-Fair - the ITE contains some (25-49%) of the affordances determined during the 
analysis 

I-Poor - the ITE contains very few (0-24%) of the affordances determined during the 
analysis 


Evaluation Results: 
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FSC contains several offensive scenarios and tools that facilitate the development and 
execution of offensive plans. Only one order may be generated at a time unless the 
trainee develops other CO As outside of the game. 

FSC supports training this action item. Overall rating: Good 
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Real World (RW) Preconditions: Trainee has understands the 
fundamentals of offensive operations (Surprise, Concentration, Audacity, 
Tempo, Flexibility); Trainee is familiar with the techniques of offensive 
operations (Movement to Contact, Attack, Exploitation, Pursuit); Trainee has 
been issued a mission order that directs his element to conduct an offensive 
operation. 

Environment Evaluation 

RW Tasks 

RW Human Abilities 

RW Affordance 
Requirements 

Environment HA 

Environmental 

Affordances 

Limit of Support to 
Training 

Identify the necessary 
offensive technique for 
the specified mission 

COGNITIVE: 

Oral Comprehension; 
Written 

Comprehension; 
Deductive Reasoning; 
Inductive Reasoning; 
Speed of Closure; 
Memorization; 

SENSORY: 

Near Vision; Speech 
Recognition 

PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity 

PHYSICAL: 

None 

- Operations order from 
the higher 
headquarters that 
informs the trainee 
about the higher 
headquarters mission 
and what tasks his 
unit is responsible for. 

- See analyze enemy 
situation 

- See perform terrain 
analysis 

- See conduct mission 
analysis 

COGNITIVE: Written 
Comprehension; 
Deductive Reasoning; 
Inductive Reasoning; 
Speed of Closure 

SENSORY: 

Near Vision 

PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity 

PHYSICAL: 

None 

- Higher HQ OPORD 

- See assess enemy 
situation 

- See perform terrain 
analysis 

- See conduct mission 
analysis 

5 - Excellent 
*4 - Very Good 

3 - Good 

2 - Fair 

1 - Poor 

Analyze own relative 
combat power 
(strengths, weaknesses) 

COGNITIVE: Written 
Comprehension; 
Deductive Reasoning; 
Inductive Reasoning; 
Problem Sensitivity; 
Mathematical 

Reasoning; 

Visualization; Speed of 
Closure; 

- See determine own 
force potential combat 
power 

COGNITIVE: Written 
Comprehension; 
Deductive Reasoning; 
Inductive Reasoning; 
Problem Sensitivity; 
Mathematical 

Reasoning; 

Visualization; Speed of 
Closure; 

- See determine own 
force potential combat 
power 

*5 - Excellent 

4 - Very Good 

3 - Good 

2 - Fair 

1 - Poor 
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SENSORY: Near 


SENSORY: Near 




Vision; 


Vision; 




PSYCHOMOTOR: 


PSYCHOMOTOR: 




Manual Dexterity; 


Manual Dexterity; 




Finger Dexterity; 


Finger Dexterity; 




PHYSICAL: 


PHYSICAL: 




None 


None 



Generate options that 

COGNITIVE: 

- Higher commanders 

COGNITIVE: 

- Scenario editor 

5 - Excellent 

incorporate the 

Deductive Reasoning; 

intent and desired 

Deductive Reasoning; 

- See perform terrain 

4 - Very Good 

fundamentals of 

Inductive Reasoning; 

endstate 

Inductive Reasoning; 

analysis 

*3 - Good 

offensive operations 

Fluency of Ideas; 

- See perform terrain 

Fluency of Ideas; 

- See assess enemy 

2 - Fair 

and offensive technique 

Originality; Problem 

analysis 

Originality; Problem 

situation 

1 - Poor 


Sensitivity; Information 

- See assess enemy 

Sensitivity; Information 

- See conduct 



Ordering; Mathematical 

situation 

Ordering; Mathematical 

reconnaissance 



Reasoning; 

- See conduct 

Reasoning; 

- See conduct mission 



Visualization; Speed of 

reconnaissance 

Visualization; Speed of 

analysis 



Closure; Memorization; 

- See conduct mission 
analysis 

Closure; Memorization; 




SENSORY: 

SENSORY: 




Near Vision 


Near Vision 




PSYCHOMOTOR: 


PSYCHOMOTOR: 




Manual Dexterity; 


Manual Dexterity; 




Finger Dexterity; 


Finger Dexterity; 




PHYSICAL: 


PHYSICAL: 




None 


None 



Array the forces 

COGNITIVE: 

- See determine own 

COGNITIVE: 

- See determine own 

5 - Excellent 

available 

Deductive Reasoning; 

force potential combat 

Deductive Reasoning; 

force potential combat 

4 - Very Good 


Information Ordering; 

power 

Information Ordering; 

power 

*3 - Good 


Visualization; Spatial 

- See develop a light 

Visualization; Spatial 

- See develop a light 

2 - Eair 


Orientation; 

infantry course of 

Orientation; 

infantry course of 

1 - Poor 


Memorization; 

action 

Memorization; 

action 




- See conduct mission 


- See conduct mission 



SENSORY: 

analysis 

SENSORY: 

analysis 
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Near Vision; 
PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity; 

PHYSICAL: None 


Near Vision; 
PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity; 

PHYSICAL: None 



Develop an offensive 

COGNITIVE: 

- See develop a light 

COGNITIVE: 

- See develop a light 

5 - Excellent 

concept of operations 

Deductive Reasoning; 

infantry course of 

Deductive Reasoning; 

infantry course of 

4 - Very Good 


Inductive Reasoning; 

action 

Inductive Reasoning; 

action 

*3 - Good 


Information Ordering; 

- See conduct 

Information Ordering; 

- See conduct 

2 - Fair 


Visualization; Problem 

reconnaissance 

Visualization; Problem 

reconnaissance 

1 - Poor 


Sensitivity; 

- See conduct mission 

Sensitivity; 

- See conduct mission 



Memorization 

analysis 

Memorization 

analysis 




- See assess civil 


- See assess civil 



SENSORY: 

considerations 

SENSORY: 

considerations 



Near Vision; Visual 


Near Vision; Visual 




Color Discrimination 


Color Discrimination 




PSYCHOMOTOR: 


PSYCHOMOTOR: 




Manual Dexterity; 


Manual Dexterity; 




Finger Dexterity 


Finger Dexterity 




PHYSICAL: 


PHYSICAL: 




None 


None 



Assign responsibilities 

COGNITIVE: 

- A way to verbally, 

COGNITIVE: 

- Order process where 

*5 - Excellent 


Deductive Reasoning; 

orally or pictorially 

Deductive Reasoning; 

tasks are assigned to 

4 - Very Good 


Problem Sensitivity; 

represent the 

Problem Sensitivity; 

units 

3 - Good 


Speed of Closure; 

responsibilities for 

Speed of Closure; 


2 - Eair 


Perceptual Speed; 

tasks/missions to 

Perceptual Speed; 


1 - Poor 


Memorization 

subordinate 

Memorization 





units/elements 





SENSORY: Near 


SENSORY: Near 




Vision; Speech Clarity 


Vision; Speech Clarity 




PSYCHOMOTOR: 


PSYCHOMOTOR: 




Manual Dexterity; 


Manual Dexterity; 




Finger Dexterity; 


Finger Dexterity; 
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PHYSICAL: None 


PHYSICAL: None 



Prepare a COA 
statement and sketch 

COGNITIVE: Written 
Expression; 

Information Ordering 

SENSORY: 

Near Vision; Visual 
Color Discrimination 

- See develop a light 
infantry COA 

COGNITIVE: Written 
Expression; 

Information Ordering 

SENSORY: 

Near Vision; Visual 
Color Discrimination 

- See develop a light 
infantry COA 

5 - Excellent 

4 - Very Good 
*3 - Good 

2 - Fair 

1 - Poor 


PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity; 


PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity; 




PHYSICAL: 

None 


PHYSICAL: 



Post-conditions: COA is developed that incorporates the fundamentals of the offense appropriately and meets the criteria of being suitable, acceptable, 
feasible, distinguishable and complete. 
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Score: Good 3.36 


Action Item: Conduct Mission Analysis 
Doctrine: FM 3-21.10, 5-0 

Preconditions: Trainee has received the mission; Trainee has issued a warning order 
(WARNO) 

Tasks: 

1. Analyze Mission 

a. Purpose 

b. Tasks 

c. Constraints 

d. Develop a Restated Mission 

2. Conduct Terrain Analysis (Separate Evaluation) 

3. Analyze Enemy Situation (Separate Evaluation) 

4. Develop Commander Critical Information Requirements (CCIR) 

5. Conduct Troop Analysis (Separate Evaluation) 

6. Conduct analysis of available time 

7. Analyze Civil Considerations (Separate Evaluation) 

8. Conduct a risk assessment 

9. Identify tentative decisive points based on conclusions and intuition 

10. Develop a commander’s intent 

11. Issue a warning order 

Post-conditions: Trainee unit’s mission is known; Trainee comprehends the current 
situation ; Trainee has a conceptual understanding of how his unit will accomplish the 
mission; Trainee has identified potential risks of the operation. 


DEFINITION OF SCALE 

5-Excellent - the TTE contains all but a few (90-100%) of the affordances determined 
during the analysis 

4-Very Good - the ITE contains a significant portion (70-89%) of the affordances 
determined during the analysis 

3-Good - the ITE contains a good portion (50-69%) of the affordances determined 
during the analysis 

2-Fair - the ITE contains some (25-49%) of the affordances determined during the 
analysis 

I-Poor - the ITE contains very few (0-24%) of the affordances determined during the 
analysis 
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Evaluation Comments: 


Mission analysis is a deliberate and detailed process that may be modified to suit the 
tactical situation. FSC provides the trainee with an environment where MA may be 
executed at various levels depending on how complete the scenario is. As noted 
previously in other analyses, the ability to issue a warning order does not exist in FSC. 
Additionally, risk assessment and management may only be done in a perfunctory 
manner using FSC. Much of this task is dependent upon the level of detailed information 
provided to the trainee in the battalion OPORD. 

FSC supports this action item. Overall rating: Good 
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Real World (RW) Preconditions: Trainee has received the mission; Trainee 
has Issued a warning order (WARNO) 

Environment Evaluation 


RW Tasks 

RW Human Abilities 

RW Affordance 
Requirements 

Environment HA 

Environmental 

Affordances 

Level of Support to 
Training 

Analyze the Mission 

COGNITIVE: 

Oral Comprehension; 
Written 

Comprehension; 
Deductive Reasoning; 
Inductive Reasoning; 
Problem Sensitivity; 
Information Ordering; 
Visualization; Speed of 
Closure; Perceptual 
Speed; Memorization; 
Time Sharing; 

SENSORY: 

Near Vision; Speech 
Recognition 

PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity; 

PHYSICAL: 

None 

- Trainee must have 
been given a mission 
with implied, 
specified and critical 
tasks. The mission 
should have a timeline 
for completion. 

- The information 
provided to the trainee 
should answer the 
questions of who, 
what, where, when 
and why or the trainee 
should be able to 
process the given 
information to draw 
inferences that answer 
the questions 

- Trainee must be able 
to review the higher 
commanders order 
and parse information 
that he deems 
necessary. The 
environment should 
support the trainee in 
parsing information, 
drafting plans and 
identifying tasks his 
unit must accomplish 

- Environment should 
support the 

COGNITIVE: 

Written 

Comprehension; 
Inductive Reasoning; 
Deductive Reasoning; 
Problem Sensitivity; 
Visualization; Speed of 
Closure; 

SENSORY: 

Near Vision 

PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity; 

PHYSICAL: 

None 

- Scenario editor and 
higher HQ order 

- Trainee not able to 
draft a mission 

statement 

5 - Excellent 
*4 - Very Good 

3 - Good 

2 - Eair 

1 - Poor 
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development and 
drafting of a mission 
statement 




Conduct Terrain 

Analysis 

See perform terrain 
analysis 

See perform terrain 
analysis 

See perform terrain 
analysis 

See perform terrain 
analysis 

5 - Excellent 
*4 - Very Good 

3 - Good 

2 - Eair 

1 - Poor 

Analyze Enemy 

Situation 

See analyze enemy 
situation 

See analyze enemy 
situation 

See analyze enemy 
situation 

See analyze enemy 
situation 

5 - Excellent 
*4 - Very Good 

3 - Good 

2 - Eair 

1 - Poor 

Develop Commander 
Critical Information 
Requirements (CCIR) 

COGNITIVE: 

Oral Expression; Oral 
Comprehension; 

Written 

Comprehension; 

Written Expression; 
Deductive Reasoning; 
Inductive Reasoning; 
Problem Sensitivity; 
Mathematical 

Reasoning; Speed of 
Closure; Perceptual 
Speed; Memorization; 
Time Sharing; 

SENSORY: 

Near Vision; Speech 
Clarity; Speech 
Recognition; 

PSYCHOMOTOR: 

Manual Dexterity; 

Einger Dexterity; 

- Trainee must be 
provided with 
materials (i.e., 
intelligence materials) 
that provide or 
support the inference 
of CCIR. 

- Tools to author, refine 
and transmit CCIR’s 
to trainee’s unit via 
voice or digital 
means. 

- A way to denote and 
link CCIR to the 
operational plan. 

COGNITIVE: 

Written 

Comprehension; 
Deductive Reasoning; 
Inductive Reasoning; 
Problem Sensitivity 

SENSORY: 

Near Vision; 

PSYCHOMOTOR: 

Manual Dexterity; 

Einger Dexterity; 

PHYSICAL: 

None 

- Scenario may provide 
higher headquarters 
CCIR if included in 
the OPORD. 

- No ability for the 
trainee to develop or 
denote CCIR for his 
unit or transmit CCIR 
as part of the 
COA/OPORD for 
execution. 

5 - Excellent 

4 - Very Good 

3 - Good 
*2 - Eair 

1 - Poor 
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PHYSICAL: 

None 





Conduct Troop 

Analysis 

See determine own 
force potential combat 
power 

See determine own 
force potential combat 
power 

See determine own 
force potential combat 
power 

See determine own 
force potential combat 
power 

*5 - Excellent 

4 - Very Good 

3 - Good 

2 - Fair 

1 - Poor 

Conduct analysis of 
available time 

COGNITIVE: 

Written 

Comprehension; Oral 
Comprehension; 
Deductive Reasoning; 
Inductive Reasoning; 
Problem Sensitivity; 
Number Facility; Speed 
of Closure; Selective 
Attention; Time 

Sharing; 

SENSORY: 

Near Vision; Speech 
Recognition 

PSYCHOMOTOR: 

None 

PHYSICAL: 

None 

- Time context i.e., the 
present time or a 
scripted future or past 
time. 

- Trainee must have a 
starting time from 
which to plan from 
and against. 

- Orders must specify a 
time or time frame for 
mission 

accomplishment so 
that the trainee may 
execute this analysis. 

- A way to develop and 
transmit a timeline for 
mission 

accomplishment 

COGNITIVE: 

Written 

Comprehension; 
Deductive Reasoning; 
Inductive Reasoning; 
Problem Sensitivity; 
Number Facility; Time 
Sharing 

SENSORY: 

Near Vision; 

PSYCHOMOTOR: 

None 

PHYSICAL: 

None 

- Game allows for play 
to go from 30 min to 
4:30 in 30 min 
increments 

- Time my begin during 
planning phase if 
selected 

- Scenario may provide 
information relating to 
when mission must 
start and be completed 
by. 

- Time is annotated on 
the CDR POV screen 
during execution of 
mission 

- Trainee unable to 
develop, display or 
transmit a timeline 

5 - Excellent 
*4 - Very Good 

3 - Good 

2 - Eair 

1 - Poor 

Analyze Civil 
Considerations 

See assess civil 
considerations 

See assess civil 
considerations 

See assess civil 
considerations 

See assess civil 
considerations 

5 - Excellent 

4 - Very Good 

3 - Good 
*2 - Eair 

1 - Poor 

Conduct a risk 

assessment 

COGNITIVE: 

Oral Comprehension; 
Written 

Comprehension; 

- See analyze enemy 
situation 

- See perform terrain 
analysis 

COGNITIVE: 

Written 

Comprehension; 
Deductive Reasoning; 

- No risk management 
plan, template or 
functionality is 
explicitly included in 

5 - Excellent 
*4 - Very Good 

3 - Good 

2 - Eair 
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Deductive Reasoning; 
Inductive Reasoning; 
Problem Sensitivity; 
Visualization; Spatial 
Orientation; Speed of 
Closure; Perceptual 
Speed; Memorization; 
Time Sharing; 

SENSORY: 

Near Vision; Speech 
Recognition 

PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity; 

PHYSICAL: 

None 

- See determine own 
force potential combat 
power 

- Environment must 
support the 
development of a risk 
management plan for 
the unit that identifies 
risks and controls 

Inductive Reasoning; 
Problem Sensitivity; 
Visualization; Speed of 
Closure; Perceptual 
Speed; Memorization; 
Time Sharing; 

SENSORY: 

Near Vision; 

PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity; 

PHYSICAL: 

None 

the game. All risk 
management 
functionality is 
implicitly included in 
other activities. 

1 - Poor 

Identify tentative 
decisive points based 
on conclusions and 
intuition 

COGNITIVE: 

Oral Comprehension; 
Written 

Comprehension; 
Deductive Reasoning; 
Inductive Reasoning; 
Problem Sensitivity; 
Visualization; Speed of 
Closure; Memorization; 
Time Sharing; 

SENSORY: 

Near Vision; Speech 
Recognition; 

PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity; 

- Scenario that contains 
information that 
supports the trainee in 
the identification and 
development of 
decisive points that 
define how, where, or 
when the unit will 
accomplish its 
purpose. 

- Information from 
intelligences sources 
about the enemy and 
the higher 
commanders intent 
and vision 

- A way to denote or 
annotate decisive 

COGNITIVE: 

Written 

Comprehension; 
Deductive Reasoning; 
Inductive Reasoning; 
Problem Sensitivity; 
Visualization; Speed of 
Closure; Memorization; 

SENSORY: 

Near Vision; 

PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity; 

PHYSICAL: 

- Scenario editor 
provides ability to 
include pertinent 
information to 

OPORD 

- Intelligence materials 
may be developed and 
added to background 
and OPORD 

5 - Excellent 

4 - Very Good 
*3 - Good 

2 - Eair 

1 - Poor 
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PHYSICAL: 

None 

points in the order or 
on the COA sketch. 

None 



Develop a commanders 
intent 

COGNITIVE: 

Written Expression; 
Deductive Reasoning; 
Problem Sensitivity; 
Information Ordering; 
Mathematical 

Reasoning; 

Visualization; Speed of 
Closure; Memorization; 

SENSORY: 

Near Vision; Speech 
Recognition; 

PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity; 

PHYSICAL: 

None 

- Outputs from 
previously identified 
steps 

- See analyze enemy 
situation 

- See perform terrain 
analysis 

- See determine own 
force potential combat 
power 

- See conduct 
reconnaissance 

- See develop a light 
infantry company 
course of action 

COGNITIVE: 

Written Expression; 
Deductive Reasoning; 
Problem Sensitivity; 
Information Ordering; 
Mathematical 

Reasoning; 

Visualization; Speed of 
Closure; Memorization; 

SENSORY: 

Near Vision; 

PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity; 

PHYSICAL: 

None 

- See analyze enemy 
situation 

- See perform terrain 
analysis 

- See determine own 
force potential combat 
power 

- See conduct 
reconnaissance 

- See develop a light 
infantry company 
course of action 

- CO A/Order 
development process 
does not include the 
ability to express the 

CL 

5 - Excellent 

4 - Very Good 
*3 - Good 

2 - Fair 

1 - Poor 

**Math; this step 
includes evaluation of 
each step for this 
subtask as well as all of 
the steps from all of the 
previous subtasks. If 
subtask was roll up of 
others then just the 
score from the umbrella 
subtask was used to 
eliminate double and 
triple counting. This 
score 3.25 

Issue a warning order 

COGNITIVE: 

- Correct order format 

COGNITIVE: 

- No warning order 

5 - Excellent 


Written 

- Means to deliver the 

None 

functionality exists 

4 - Very Good 


Comprehension, Oral 

WO 


within ESC 

3 - Good 


Expression, Written 

- Information from 

SENSORY: 


*2 - Fair 


Expression; 

previous steps 

None 


1 - Poor 


SENSORY: 


PSYCHOMOTOR: 


**Step would have 


Near Vision; Speech 


None 


been rated as poor if 


Clarity 




affordances not treated 




PHYSICAL: 


equally. 


PSYCHOMOTOR: 


None 




Arm Hand Steadiness; 






Manual Dexterity; 






Finger Dexterity; 
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PHYSICAL: 

Extent Flexibility 





Post-conditions: Trainee unit’s mission is known; Trainee comprehends the current situation; Trainee has a conceptual understanding of how his unit will 
accomplish the mission; Trainee has identified potential risks of the operation 
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Score: Very Good 4.00 


Action Item: Plan Breaching Operations 
Doctrine: FM 3-21.10, 5-0 

Preconditions: Mission order received directing unit to conduct breaching operations as 
part of or as their mission; Task organization for mission is provided; Breaching assets 
are allocated and provided to trainee. 

Task: Trainee applies the five tenants of planning for breach operations: intelligence, 
fundamentals, organization, mass and synchronization. 

1. Trainee evaluates the enemy situation and applies this information to his plan 

2. Trainee considers the terrain and how it supports breach execution (approach 
routes; primary/altemate breach point; SBF position; fire support positioning) 

3. Trainee organizes his assets (i.e., support, breach and assault forces and security 
element) 

4. Trainee applies the fundamentals of breaching (SOSRA) suppress, obscure, 
secure, reduce, and assault in planning 

5. Trainee synchronizes the positioning and effects of all aspects of breaching 
through the use of control measures 

6. Trainee authors the plan. 

Post-conditions: Synchronized breaching plan developed. 

DEFINITION OF SCALE 

5-Excellent - the TTE contains all but a few (90-100%) of the affordances determined 
during the analysis 

4-Very Good - the ITE contains a significant portion (70-89%) of the affordances 
determined during the analysis 

3-Good - the ITE contains a good portion (50-69%) of the affordances determined 
during the analysis 

2-Fair - the ITE contains some (25-49%) of the affordances determined during the 
analysis 

I-Poor - the ITE contains very few (0-24%) of the affordances determined during the 
analysis 
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Evaluation Results: 


FSC contains a scenario editor that provides the opportunity to develop scenarios 
requiring breaching. The trainee is able to conduct limited planning and synchronization 
during both planning and during execution of breaching operations. 

FSC supports the training of this action item. Overall rating: Very Good 
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Real World (RW) Preconditions: Mission order received directing unit 
conduct breaching operations as part of or as their mission; Task organization 
provided; Breaching assets allocated 

Environment Evaluation 

RW Tasks 

RW Human Abilities 

RW Affordance 
Requirements 

Environment HA 

Environmental 

Affordances 

Limit of Support to 
Training 

Trainee evaluates the 
enemy situation and 
applies this information 
to his plan. 

- See analyze enemy 
situation 

- See analyze enemy 
situation 

- See analyze enemy 
situation 

- See analyze enemy 
situation 

5 - Excellent 
*4 - Very Good 

3 - Good 

2 - Fair 

1 - Poor 

Trainee considers the 
terrain and how it 
supports breach 
execution (approach 
routes; 

primary/alternate 
breach point; SBF 
position; Fire support 
positioning) 

- See perform terrain 
analysis 

- See perform terrain 
analysis 

- See perform terrain 
analysis 

- See perform terrain 
analysis 

5 - Excellent 
*4 - Very Good 

3 - Good 

2 - Eair 

1 - Poor 

Trainee organizes his 
assets recognizing 
strengths and 
weaknesses (i.e.. 

Support, Breach and 
Assault Forces & 

Security element) 

- See determine own 
force potential combat 
power 

- See determine own 
force potential combat 
power 

- See determine own 
force potential combat 
power 

- See determine own 
force potential combat 
power 

*5 - Excellent 

4 - Very Good 

3 - Good 

2 - Eair 

1 - Poor 

Trainee applies the 
fundamentals of 
breaching (SOSRA) 
suppress, obscure, 
secure, reduce, and 
assault in planning 

COGNITIVE: 

Deductive Reasoning; 
Inductive Reasoning; 
Problem Sensitivity; 
Information Ordering; 
Visualization; Spatial 
Orientation; 
Memorization 

SENSORY: 

Near Vision; Visual 

- Tools that allow the 
trainee to develop and 
manipulate a 
breaching plan (e.g., 
alcohol pens, mission 
command systems) 

- See develop a light 
infantry company 

COA 

COGNITIVE: 

Deductive Reasoning; 
Problem Sensitivity; 
Information Ordering; 
Visualization; 

SENSORY: 

Near Vision; Visual 
Color Discrimination 

PSYCHOMOTOR: 

- Game order planning 
screen allows trainee 
to build plan and 
adjust as desired 

5 - Excellent 
*4 - Very Good 

3 - Good 

2 - Eair 

1 - Poor 
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Color Discrimination 

PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity 

PHYSICAL: 

None 


Manual Dexterity; 

Linger Dexterity 

PHYSICAL: 

None 



Trainee synchronizes 
the positioning and 
effects of all aspects of 
breaching through the 
use of control measures 

COGNITIVE: 

Deductive Reasoning; 
Problem Sensitivity; 
Information Ordering; 
Visualization; 
Memorization 

SENSORY: 

Near Vision; 

PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity; 

PHYSICAL:None 

- A method and tools 
(e.g., mission 
command system) for 
developing a plan 

- Doctrinal graphical 
symbology (e.g., 
control measures) 

- See develop a light 
infantry company 

COA 

- A method to conduct 
time and battlespace 
synchronization 
during planning 

COGNITIVE: 

Deductive Reasoning; 
Problem Sensitivity; 
Information Ordering; 
Visualization; 

SENSORY: 

Near Vision; 

PSYCHOMOTOR: 

Manual Dexterity; 

Linger Dexterity; 

PHYSICAL: None 

- OPORD planning 
screen allows trainee 
to build a plan using 
phases and other 
limited doctrinal 
control measures 

- Phase lines, breach 
symbol 

- See develop a light 
infantry COA 

5 - Excellent 
*4 - Very Good 

3 - Good 

2 - Lair 

1 - Poor 

Trainee authors the 
plan 

COGNITIVE: 

Oral Expression; 

Written Expression; 

SENSORY: 

Near Vision, Visual 
Color Discrimination 

PSYCHOMOTOR: 

Manual Dexterity; 

Einger Dexterity; 

PHYSICAL: None 

- Tools to draft/build 
the plan (e.g., maps, 
acetate, alcohol pens, 
mission command 
system) 

- A way to depict the 
plan so others may see 
and understand it 
(e.g., butcher boards, 
mission command 
systems) 

COGNITIVE: Written 
Expression; 

SENSORY: 

Near Vision, Visual 
Color Discrimination 

PSYCHOMOTOR: 

Manual Dexterity; 

Linger Dexterity; 

PHYSICAL: None 

- Game provides 
functionality to 
develop an order that 
includes breaching 
information 

5 - Excellent 

4 - Very Good 
*3 - Good 

2 - Eair 

1 - Poor 

Post-conditions: Synchronized plan for breaching an obstacle exists 
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Score: Very Good 4.00 

Action Item: Apply the fundamentals of conducting a movement to contact (MTC) 


Doctrine: FM 3-21.10, 3-90 

Preconditions: Mission order received directing unit to conduct offensive operations to 
gain intelligence or contact with an enemy force; Trainee is knowledgeable of doctrine 
about how to conduct a MTC and the fundamentals of conducting a MTC; Trainee is 
proficient in the development of MTC COA 

Tasks: 

1. Develop a plan/COA that includes the following fundamentals: 

a. Focus all reconnaissance efforts on finding the enemy 

b. Make contact with the enemy using the smallest element possible 
(visual contact preferred) 

c. Avoid decisive engagement with the main body until conditions 
are favorable 

d. Maintain freedom of maneuver and mutual support between and 
within unit elements 

e. Maintain contact with the enemy 

2. Command and control the execution of the plan 


Post-conditions: Contact made with the enemy on favorable terms; Unit achieves 
tactical/operational objectives 

DEFINITION OF SCALE 

5-Excellent - the TTE contains all but a few (90-100%) of the affordances determined 
during the analysis 

4-Very Good - the ITE contains a significant portion (70-89%) of the affordances 
determined during the analysis 

3-Good - the ITE contains a good portion (50-69%) of the affordances determined 
during the analysis 

2-Fair - the ITE contains some (25-49%) of the affordances determined during the 
analysis 

I-Poor - the ITE contains very few (0-24%) of the affordances determined during the 
analysis 
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Evaluation Comments: 


FSC supports the development and depiction of courses of action as orders and 
fragmentary orders. The game does not support separate COA development from order 
development. Users are able to develop plans that incorporate the fundamentals of MTC. 
Trainees are unable to physically C2 their elements on the field but may do so through an 
avatar that represents them in the game. The commander may make adjustments to his 
plan during execution and interact with his forces via simulated radio communications. 
The limited intelligence of the avatars prevents adherence to the fundamentals of MTC 
which is a problem however that does not significantly affect the trainee’s ability to react 
to the contact. 

FSC supports this action item. Overall rating: Very Good 
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Real World (RW) Preconditions: Mission order received directing unit to 
conduct offensive operations to gain intelligence or contact with an enemy 
force; Trainee is knowledgeable of doctrine about how to conduct a MTC and 
the fundamentals of conducting a MTC; Trainee is proficient in the 
development of MTC COA 

Environment Evaluation 

RW Tasks 

RW Human Abilities 

RW Affordance 
Requirements 

Environment HA 

Environmental 

Affordances 

Level of Support to 
Training 

Develop a course of 

action that includes: 

- Focus all 
reconnaissance efforts 
on finding the enemy 

- Make contact with the 
enemy using the 
smallest element 
possible (visual 
contact preferred) 

- Avoid decisive 
engagement with the 
main body until 
conditions are 
favorable 

- Maintain freedom of 
maneuver and mutual 
support between and 
within unit elements 

- Maintain contact with 
the enemy 

COGNITIVE: 

Oral Comprehension; 
Written 

Comprehension; 
Deductive Reasoning; 
Fluency of Ideas; 
Information Ordering; 
Mathematical 

Reasoning; Speed of 
Closure; Memorization; 
Selective Attention 

SENSORY: 

Near Vision; 

PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity; 

PHYSICAL: 

None 

- Higher Commanders 
intent and desired 
operational endstate 

- See determine own 
force potential combat 
power 

- See perform terrain 
analysis 

- See assess enemy 
situation 

- See develop a light 
infantry course of 
action 

- Intelligent Soldiers 
that are knowledgeable 
of MTC fundamentals 
and doctrine 

COGNITIVE: 

Written 

Comprehension; 
Deductive Reasoning; 
Fluency of Ideas; 
Information Ordering; 
Memorization; 

SENSORY: 

Near Vision; 

PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity; 

PHYSICAL: 

None 

- Scenario editor allows 
for the inclusion of 
commanders intent 
and desired endstate. 

- Planning tab includes 
an orders development 
capability that allows 
the trainee to build an 
Order. 

- Trainee does not have 
any control over the 
movement of the 
individual avatars 

5 - Excellent 
*4 - Very Good 

3 - Good 

2 - Eair 

1 - Poor 

Command and Control 
the execution of the plan 

COGNITIVE: 

Oral Expression; Oral 
Comprehension; 

Written 

- Intelligent Soldiers 
that are knowledgeable 
of MTC fundamentals 

COGNITIVE: 

Oral Comprehension; 
Written 

Comprehension; 

- Scenario representing 
environment, higher 
commander and own 

5 - Excellent 
*4 - Very Good 

3 - Good 

2 - Eair 
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Comprehension; 
Deductive Reasoning; 
Fluency of Ideas; 
Inductive Reasoning; 
Originality; Problem 
Sensitivity; Information 
Ordering; Mathematical 
Reasoning; 
Visualization; Spatial 
Orientation; Speed of 
Closure; Perceptual 
Speed; Memorization; 
Selective Attention; 
Time Sharing; 

SENSORY: 

Night Vision; Peripheral 
Vision; Glare 
Sensitivity; Depth 
Perception; Far Vision; 
Near Vision; Visual 
Color Discrimination; 
Auditory Attention; 
Speech Clarity; Speech 
Recognition; Hearing 
Sensitivity; Sound 
Localization; 

PSYCHOMOTOR: 

Arm-Hand Steadiness; 
Manual Dexterity; 
Finger Dexterity; 
Control Precision; 
Response Orientation; 
Rate Control; Multilimb 
Coordination; 


and doctrine 

- Tactical scenario that 
provides a higher 
commander, enemy 
and physical 
environment. 

- Verbal or digital 
communication 
capability between the 
trainee, his unit 
elements and his 
higher headquarters. 

- Physical or visual 
interaction between 
the trainee, his 
subordinate elements, 
his higher 

headquarters and the 
enemy. 

- Environment should 
afford the trainee a 
way to adjust his plan 
and issue new orders 
during the scenario as 
in real life. 


Deductive Reasoning; 
Fluency of Ideas; 
Inductive Reasoning; 
Information Ordering; 
Spatial Orientation; 
Memorization; Time 
Sharing; 

SENSORY: 

Near Vision; Visual 
Color Discrimination; 

PSYCHOMOTOR: 

Manual Dexterity; 
Finger Dexterity; 

PHYSICAL: 

None 


unit elements and 
enemy 

- Limited scripted 
simulated radio 
communications 

- Limited simulated 
visual/physical contact 
with enemy, own 
troops and higher 
headquarters 

- FRAGO capability is 
present 


1 - Poor 

** This item would be 
rated as Fair due to the 
limited interaction 
between the game 
entities and the trainee if 
affordances were not all 
considered equal 


208 





PHYSICAL: 

Explosive Strength; 

Trunk Strength; 

Stamina; Extent 
Elexibility; Gross Body 
Coordination; Gross 

Body Equilibrium 





Issue a Fragmentary 

Order [FRAGO] (as 
needed) 

See issue a fragmentary 
order 

See issue a fragmentary 
order 

See issue a fragmentary 
order 

See issue a fragmentary 
order 

See issue a fragmentary 
order 

Post-conditions: Contact made with the enemy on favorable terms; Unit achieves tactical/operational objectives 


209 




Score: Very Good 4.00 


Action Item: Integrate Fire Support Into Urban Operations 

Doctrine: FM 3-21.10 

Preconditions: Mission order provided to trainee; Fire support assets available to the 

trainee are specified; Trainee is knowledgeable on urban operations (UO) doctrine, the 

current ROE for use of indirect fire/mortars and the enemy situation. 

Tasks: 

1. Process information on the capabilities of own unit and general fire support assets 
available 

2. Process information concerning the enemy’s capabilities and possible use of 
urban terrain 

3. Process information concerning the ROE and any civil considerations affected by 
the use of indirect fire/mortars 

4. Develop a fire support plan for the mission 


Post-conditions: Eire Support plan is developed; Eire Support Coordination and Control 
measures are known by the unit; Eire support is integrated into the movement and 
maneuver plan. 


DEFINITION OF SCALE 

5-Excellent - the FTE contains all but a few (90-100%) of the affordances determined 
during the analysis 

4-Very Good - the ITE contains a significant portion (70-89%) of the affordances 
determined during the analysis 

3-Good - the ITE contains a good portion (50-69%) of the affordances determined 
during the analysis 

2-Fair - the ITE contains some (25-49%) of the affordances determined during the 
analysis 

I-Poor - the ITE contains very few (0-24%) of the affordances determined during the 
analysis 
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Evaluation Results: 


FSC only includes those organic indirect fire assets resident in a light infantry company 
(i.e., mortars). Trainees are provided information about the use/restriction of mortars 
depending on the scenario that is editable. FSC only provides scaffolding in the form of 
graphic control measures necessary to control or activate indirect fires for two types of 
missions. Trainees have the ability using FSC to think through how they would employ 
mortar assets in support of a maneuver plan. 

FSC supports this action item. Overall rating: Very Good 
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Real World (RW) Preconditions: Mission order provided to trainee; Fire 
support assets available to the trainee are specified; Trainee is knowledgeable 
on Urban Operations (UO) doctrine, the current ROE for use of indirect 
fire/mortars and the enemy situation 

Environment Evaluation 

RW Tasks 

RW Human Abilities 

RW Affordance 
Requirements 

Environment HA 

Environmental 

Affordances 

Limit of Support to 
Training 

Process information on 
the capabilities of own 
unit and general fire 
support assets available 

COGNITIVE: 

Written 

Comprehension; Oral 
Comprehension; 
Deductive Reasoning; 
Inductive Reasoning; 
Problem Sensitivity; 
Speed of Closure 

SENSORY: 

Near Vision; Speech 
Recognition 

PSYCHOMOTOR: 

None 

PHYSICAL: 

None 

- See assessment of 
determine own force 
potential combat 
power. 

- Information about any 
additional fire support 
assets allocated for the 
unit’s use during an 
operation (e.g., size, 
number, etc.) 

COGNITIVE: 

Written 

Comprehension; 
Inductive Reasoning; 
Problem Sensitivity; 
Speed of Closure 

SENSORY: 

Near Vision; 

PSYCHOMOTOR: 

Manual Dexterity, 

Finger Dexterity 

PHYSICAL: None 

- Editable scenario that 
may provide detail as 
necessary 

- Default force structure 
that includes mortar 

assets 

*5 - Excellent 

4 - Very Good 

3 - Good 

2 - Fair 

1 - Poor 

Process information 
concerning the enemy’s 
capabilities and 
possible use of urban 
terrain 

COGNITIVE: 

Written 

Comprehension; Oral 
Comprehension; 
Deductive Reasoning; 
Inductive Reasoning; 
Problem Sensitivity; 
Visualization; 
Memorization 

SENSORY: 

Near Vision; Speech 
Recognition 

- See analyze enemy 
situation 

- See perform terrain 
analysis 

COGNITIVE: 

Written 

Comprehension; 
Deductive Reasoning; 
Inductive Reasoning; 
Problem Sensitivity; 
Visualization; 

SENSORY: 

Near Vision 

PSYCHOMOTOR: 

None 

- See analyze enemy 
situation 

- See perform terrain 
analysis 

5 - Excellent 
*4 - Very Good 

3 - Good 

2 - Fair 

1 - Poor 
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PSYCHOMOTOR: 

None 


PHYSICAL: 

None 




PHYSICAL: None 





Process information 
concerning the ROE 
and any civil 
considerations affected 
by the use of indirect 
fire/mortars 

COGNITIVE: 

Written 

Comprehension; Oral 
Comprehension; 
Deductive Reasoning; 
Inductive Reasoning; 
Problem Sensitivity; 
Visualization; 
Memorization 

SENSORY: 

Near Vision; Speech 
Recognition 

- ROE considerations 
dealing with indirect 
fires/mortars 

- See assess civil 
considerations 

COGNITIVE: 

Written 

Comprehension; 
Deductive Reasoning; 
Inductive Reasoning; 
Problem Sensitivity; 
Visualization; 

SENSORY: 

Near Vision; 

PSYCHOMOTOR: 

None 

- Adjustable ROE 
setting and 
information 

- See assess civil 
considerations 

5 - Excellent 

4 - Very Good 
*3 - Good 

2 - Eair 

1 - Poor 


PSYCHOMOTOR: 

None 


PHYSICAL: 

None 




PHYSICAL: 

None 





Develop a fire support 
plan for the mission 
that considers the use of 
high explosive, smoke 
and illumination 
ordinance and targets 
that support the 
execution of the tactical 
plan 

COGNITIVE: 

Written Expression; 
Deductive Reasoning; 
Eluency of Ideas; 
Originality; Problem 
Sensitivity; Information 
Ordering; Spatial 
Orientation; Speed of 
Closure; Memorization; 

SENSORY: 

Near Vision 

PSYCHOMOTOR: 

- See assessment for 
develop a light 
infantry CO A. 

- See perform terrain 
analysis 

- Means to graphically 
display fire control 
measures on the area 
of operations 

- Necessary doctrinal 
symbology 

- A means to coordinate 
fire support with 
outside sources if 

COGNITIVE: 

Written Expression; 
Deductive Reasoning; 
Eluency of Ideas; 
Originality; Problem 
Sensitivity; Information 
Ordering; Speed of 
Closure; 

SENSORY: 

Near Vision 

PSYCHOMOTOR: 

Manual Dexterity; 

- See develop a light 
infantry COA 

- See perform terrain 
analysis 

- Ability to place targets 
and task mortars 

- TRP and Illumination 
symbols only 

5 - Excellent 
*4 - Very Good 

3 - Good 

2 - Eair 

1 - Poor 
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Manual Dexterity; 

Finger Dexterity; 

PHYSICAL: 

None 

required 

Finger Dexterity; 

PHYSICAL: 

None 



Post-conditions: Fire Support plan is developed; Fire Support Coordination and Control measures are known by the unit; Fire support is integrated into the 
movement and maneuver plan 
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Score: Good 3.00 


Action Item(s): Issue Infantry Company or Company-Team Operations Order 
(OPORD) 

Doctrine: FM 5-0, 3-21.10 

Preconditions: Trainee has received an operations order from his/her higher 
headquarters with supporting materials (e.g., graphics, enemy situational templates); 
Trainee has conducted a preliminary mission analysis on the higher commanders order; 
Trainee has developed a 5-paragraph operations order to provide direction to a unit for 
the execution of a mission. 

Task: 

1. Issue the OPORD Verbally 

2. Issue the OPORD Digitally 


Post-conditions: New information has been transmitted from commander to unit; Unit 
elements acknowledge receipt of OPORD. 

DEFINITION OF SCALE 

5-Excellent - the TTE contains all but a few (90-100%) of the affordances determined 
during the analysis 

4-Very Good - the ITE contains a significant portion (70-89%) of the affordances 
determined during the analysis 

3-Good - the ITE contains a good portion (50-69%) of the affordances determined 
during the analysis 

2-Fair - the ITE contains some (25-49%) of the affordances determined during the 
analysis 

I-Poor - the ITE contains very few (0-24%) of the affordances determined during the 
analysis 

Evaluation Results: 

ESC supports the digital transmission of a matrix style OPORD to the simulated unit. The 
matrix order does not cover the 5 paragraphs of the standard written format. There is no 
way to enhance the order via the scenario editor. Despite this, order information is 
transmittable for unit execution. 

ESC supports the training of this action item. Overall Rating: Good 
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Real World (RW) Preconditions: Trainee has received an operations order 
from his/her higher headquarters with supporting materials (e.g., graphics, 
enemy situational templates); Trainee has conducted a preliminary mission 
analysis on the higher commanders order; trainee has developed a 5-paragraph 
operations order to provide direction to a unit for the execution of a mission. 

Environment Evaluation 

OPORD developed by users of FSC is a matrix style order that does not 
follow doctrinal guidelines. 

RW Tasks 

RW Human Abilities 

RW Affordance 
Requirements 

Environment HA 

Environmental 

Affordances 

Level of Support to 
training 

Issue OPORD verbally 

- Read OPORD 

- Verbally transmit 
information 

COGNITIVE: 

Written 

Comprehension; Oral 
Expression 

SENSORY: 

Near Vision; Speech 
Clarity 

PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity 

PHYSICAL: 

None 

- 5-paragraph OPORD 

- A means to amplify 
the voice so that 
transmission of the 
OPORD may occur if 
the audience is not 
within hearing range 
(e.g., radio) 

COGNITIVE: 

None 

SENSORY: 

Near Vision; 

PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity 

PHYSICAL: 

None 

- Simulated unit 

- No means to verbally 
transmit information 

- Matrix order 

5 - Excellent 

4 - Very Good 
*3 - Good 

2 - Fair 

1 - Poor 

**Task would be rated 
Poor if task elements 
were not treated 
equally. 

Issue OPORD digitally 

COGNITIVE: 

Deductive Reasoning; 

SENSORY: 

Near Vision 

PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity 

PHYSICAL: 

None 

- 5-paragraph OPORD 

- A way to digitally 
deliver or transmit the 
order (e.g., mission 
command system) 

COGNITIVE: 

Deductive Reasoning 

SENSORY: 

Near Vision 

PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity 

PHYSICAL: 

None 

- Simulated digital 
transmission of 

OPORD 

- Simulated unit 

- Matrix order 

5 - Excellent 

4 - Very Good 
*3 - Good 

2 - Fair 

1 - Poor 

Post-conditions: New information has been transmitted from commander to unit; Unit elements acknowledge receipt of OPORD. 
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Score: Good 2.66 


Action Item: Conduct Reconnaissance 
Doctrine: FM 5-0, 3-21.10 

Preconditions: Trainee receives mission orders (WARNO, FRAGO OPORD) from a 
higher headquarters; Trainee is proficient with the troop leading procedures and METT- 
TC; Trainee has executed steps 1-4 of the TLP; Trainee is familiar with mission analysis. 


Task: Reconnoiter 

1. Trainee identifies areas of his tentative plan where reconnaissance is necessary to 
complete the plan. 

2. Trainee identifies/derives information requirements (IR) 

3. Trainee determines the type of reconnaissance to conduct based on METT-TC 
considerations and IRs. 

a. Physical (i.e., Key leader reconnaissance of the ground) 

b. Materials based reconnaissance (i.e., review of materials provided to him by his 

higher headquarters [e.g., aerial photos, map intelligence]) 

4. Reconnaissance conducted: 

a. Personally by leader 

b. By tasked elements within unit based on IRs. 

5. If trainee assigned elements to conduct reconnaissance, the trainee receives back brief 

on the results of the reconnaissance so that he can complete his plan. 

6. If conducted as part of ongoing operations, trainee repeats steps 3-5 as necessary to 

maintain a current assessment. 

Post-conditions: Reconnaissance of terrain conducted; Reconnaissance of enemy 
conducted; Information requirements developed and distributed 


DEFINITION OF SCALE 

5-Excellent - the ITE contains all but a few (90-100%) of the affordances determined 
during the analysis 

4-Very Good - the ITE contains a significant portion (70-89%) of the affordances 
determined during the analysis 

3-Good - the ITE contains a good portion (50-69%) of the affordances determined 
during the analysis 
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2-Fair - the ITE contains some (25-49%) of the affordances determined during the 
analysis 

1-Poor - the ITE contains very few (0-24%) of the affordances determined during the 
analysis 


Evaluation Comments: 

This action item is too vague. Reconnaissance is conducted constantly during military 
operations both in planning and execution. To reconnoiter using ESC means that physical 
reconnaissance is not possible leaving the evaluator to consider how well the system 
supports a trainee’s ability to conduct a map reconnaissance. Each of the tactical 
scenarios provides various map views and often times simulated photography of areas of 
importance. With these items a trainee is able to conduct one form of reconnaissance of 
his area of operations. It is possible to fake reconnaissance assignments by tasking units 
to move to locations where if they encounter the enemy they will engage and report. That 
would be a form of reconnaissance by fire. 

ESC supports this action item. Overall rating: Good 
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Real World (RW) Preconditions: Trainee receives mission orders (WARNO, 
FRAGO OPORD) from a higher headquarters; Trainee is proficient with the 
troop leading procedures and METT-TC; Trainee has already executed steps 1- 
4 of the TLP; Trainee is familiar with mission analysis. 

Environment Evaluation 

RW Tasks 

RW Human Abilities 

RW Affordance 
Requirements 

Environment HA 

Environmental 

Affordances 

Level of Support to 
Training 

Trainee identifies areas 
of his tentative plan 
where reconnaissance is 
necessary to complete 
the plan. 

COGNITIVE: 

Deductive Reasoning; 
Inductive Reasoning; 
Problem Sensitivity; 
Visualization; 

Perceptual Speed; Time 
Sharing; Memorization 

SENSORY: 

Near Vision; 

PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity; 

PHYSICAL: 

None 

- See Analyze Enemy 
Situation 

- See Perform Terrain 
Analysis 

- See Develop a Light 
Infantry COA 

- A tentative plan 

COGNITIVE: 

Inductive Reasoning; 
Problem Sensitivity; 
Visualization; 
Memorization 

SENSORY: 

Near Vision; 

PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity; 

PHYSICAL: 

None 

- See Analyze Enemy 
Situation 

- See Perform Terrain 
Analysis 

- See Develop a Light 
Infantry COA 

- No development of a 
reconnaissance plan is 
possible 

- No initial plans are 
developed needing 
reconnaissance 

5 - Excellent 

4 - Very Good 
*3 - Good 

2 - Fair 

1 - Poor 

Trainee identifies and 
derives his information 
requirements (IR) 

COGNITIVE: 

Written Expression; 
Deductive Reasoning; 
Inductive Reasoning; 
Problem Sensitivity; 
Information Ordering; 
Visualization; Spatial 
Orientation; Time 

Sharing; 

SENSORY: 

Near Vision; 

PSYCHOMOTOR: 

- Higher headquarters 
information 
requirements (IR) and 
commanders critical 
information 
requirements (CCIR) 

- See Analyze Enemy 
Situation 

- See Perform Terrain 
Analysis 

- A way to capture IRs 
in words or pictures 

COGNITIVE: 

Written Expression; 
Deductive Reasoning; 
Inductive Reasoning; 
Problem Sensitivity; 
Information Ordering; 
Visualization; Spatial 
Orientation; Time 

Sharing; 

SENSORY: 

Near Vision; 

PSYCHOMOTOR: 

- Scenario can included 
IR’s and CCIRs from 
higher commander 

- See Analyze Enemy 
Situation 

- See Perform Terrain 
Analysis 

- No capability to 
capture IRs in pictures 
or words 

5 - Excellent 

4 - Very Good 
*3 - Good 

2 - Fair 

1 - Poor 
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Manual Dexterity; 

Finger Dexterity; 

PHYSICAL: 

None 


Manual Dexterity; 

Finger Dexterity; 

PHYSICAL: 

None 



Trainee determines the 
type of reconnaissance 
to conduct (e.g., map or 
LDR Recon) based on 
METT-TC 

considerations and IRs 

COGNITIVE: 

Inductive Reasoning; 
Problem Sensitivity; 
Visualization; Spatial 
Orientation; Speed of 
Closure; Time Sharing 

SENSORY: 

Near Vision; 

PSYCHOMOTOR: 

None 

PHYSICAL: 

None 

- See Analyze Enemy 
Situation 

- See Perform Terrain 
Analysis 

- The ability to conduct 
all forms of 
reconnaissance 

COGNITIVE: 

Inductive Reasoning 

SENSORY: 

Near Vision; 

PSYCHOMOTOR: 

None 

PHYSICAL: 

None 

- System limited to map 
reconnaissance only 

- See Analyze Enemy 
Situation 

- See Perform Terrain 
Analysis 

5 - Excellent 

4 - Very Good 
*3 - Good 

2 - Fair 

1 - Poor 

Physical reconnaissance 

COGNITIVE: 

Problem Sensitivity; 
Spatial Orientation; 
Flexibility of Closure; 
Speed of Closure; 
Perceptual Speed; Time 
Sharing 

SENSORY: 

Night Vision; Peripheral 
Vision; Glare 

Sensitivity; Depth 
Perception; Far Vision; 
Near Vision; Visual 

Color Discrimination; 
Auditory Attention; 
Speech Recognition; 

- Environment must 
provide the physical 
and sensory 
information (e.g., 
trees, brush etc.) 
necessary to replicate 
the high physical 
fidelity of conducting 
reconnaissance. Types 
of physical actions 
may include walking, 
crawling, using optics, 
navigation with 
map/GPS etc. 

- Visual and sensory 
information of enemy 
activity for trainee to 

COGNITIVE: 

Problem Sensitivity; 

SENSORY: 

Near Vision; Visual 

Color Discrimination; 

PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity; 

PHYSICAL: 

None 

- System does not 
support physical 
reconnaissance 

5 - Excellent 

4 - Very Good 

3 - Good 

2 - Fair 
*1 - Poor 
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Hearing Sensitivity; 

Sound Localization; 

PSYCHOMOTOR: 

Arm-Hand Steadiness; 
Manual Dexterity; 

Finger Dexterity; 

Control Precision; 
Response Orientation; 
Rate Control; Multilimb 
Coordination; Reaction 
Time; Speed of Limb 
Movement; 

PHYSICAL: 

Static Strength; 

Explosive Strength 
Dynamic Strength; 

Trunk Strength; 

Stamina; Extent 
Elexibility; Gross Body 
Coordination; Gross 

Body Equilibrium 

see and comprehend 

- Replication of friendly 
and enemy equipment 
and personnel 

- Replication of 
operational terrain and 
weather 

- See perform terrain 
analysis 

- See analyze civil 
considerations 




Map Reconnaissance 

COGNITIVE: 

Written 

Comprehension; 

Inductive Reasoning; 
Problem Sensitivity; 
Visualization; Spatial 
Orientation; Elexibility 
of Closure; Speed of 
Closure; Perceptual 

Speed; 

SENSORY: 

Near Vision; 

- Computer automation 
assets (i.e., mission 
command system) if 
used for command and 
control 

- See perform terrain 
analysis 

- See assess enemy 
situation 

COGNITIVE: 

Written 

Comprehension; 

Inductive Reasoning; 
Problem Sensitivity; 
Visualization; Spatial 
Orientation; Elexibility 
of Closure; Speed of 
Closure; 

SENSORY: 

Near Vision; 

PSYCHOMOTOR: 

- Scenario editor allows 
for simple map views 
and simulated visual 
intelligence products 
to be provided to the 
trainee as part of the 
Higher headquarters 
OPORD 

- Game acts as the 
default automation 

asset 

5 - Excellent 
*4 - Very Good 

3 - Good 

2 - Eair 

1 - Poor 
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PSYCHOMOTOR: 

Arm-Hand Steadiness; 
Manual Dexterity; 

Finger Dexterity; 

PHYSICAL: 

None 


Manual Dexterity; 

Finger Dexterity; 

PHYSICAL: 

None 



If trainee assigned 
elements to conduct 
reconnaissance, the 
trainee receives back 
brief on the results of 
the reconnaissance so 
that he can complete his 
plan 

COGNITIVE: 

Oral Comprehension; 
Written 

Comprehension; 

Inductive Reasoning; 
Problem Sensitivity; 
Information Ordering; 
Visualization; Spatial 
Orientation; Speed of 
Closure; Perceptual 
Speed; Memorization; 
Time Sharing; 

SENSORY: 

Near Vision; Speech 
Recognition; 

PSYCHOMOTOR: 

Arm-Hand Steadiness; 
Manual Dexterity; 

Finger Dexterity 

PHYSICAL: 

None 

- Visual products 
associated with the 
reconnaissance 
conducted e.g., maps, 
sketches, and photos 
taken. 

- Computer automation 
to assist visualization 
(e.g., mission 
command system) 

- Verbal reconstruction 
of reconnaissance 
conducted 

COGNITIVE: 

Oral Comprehension; 
Inductive Reasoning; 
Problem Sensitivity; 
Spatial Orientation; 

Speed of Closure; 
Perceptual Speed; 
Memorization; 

SENSORY: 

Near Vision; Speech 
Recognition; 

PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity 

PHYSICAL: 

None 

- Reports from elements 
tasked to execute non¬ 
reconnaissance type 
missions that the 
trainee hopes will 
provide more 
information about the 
enemy 

5 - Excellent 

4 - Very Good 

3 - Good 
*2 - Fair 

1 - Poor 

If conducted as part of 
ongoing operations, 
trainee repeats steps 3-5 
as necessary to maintain 
a current assessment. 






Post-conditions: Reconnaissance of terrain conducted; Reconnaissance of enemy conducted; Information requirements developed and distributed 
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Score: Good 3.50 


Action Item: Develop a Light Infantry Course of Action 
Doctrine: FM 3-21.10; 5-0 

Preconditions: Mission order has been issued and received by the trainee. 


Task: Develop a COA 

1. Analyze relative combat power (strengths and weaknesses) 

2. Generate Options about how to successfully execute the mission 

3. Array Forces available based on the options developed to determine troops 
to task 

4. Develop a concept of operations that describes how the leader envisions 
the operation unfolding, from its start to its conclusion or end state. 

5. Assign responsibilities for tasks to subordinate elements by name 

6. Prepare a COA statement and sketch that describes the operation 

Post-conditions: COA meets the criteria of being suitable, feasible, acceptable, 
distinguishable, complete. 


DEFINITION OF SCALE 

5-Excellent - the FTE contains all but a few (90-100%) of the affordances determined 
during the analysis 

4-Very Good - the ITE contains a significant portion (70-89%) of the affordances 
determined during the analysis 

3-Good - the ITE contains a good portion (50-69%) of the affordances determined 
during the analysis 

2-Fair - the ITE contains some (25-49%) of the affordances determined during the 
analysis 

I-Poor - the ITE contains very few (0-24%) of the affordances determined during the 
analysis 
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Evaluation Comments: 


FSC does not separate COA development from the development of the matrix style 
operations order. This means that the COA that is developed is done so as a matrix style 
order that the unit will execute if implemented. Trainees are able to array forces, evaluate 
combat power and assign responsibilities as part of the orders process. Arraying forces is 
not completed in a generic fashion as intended rather this step and assigning 
responsibility for tasks are combined. The game does not support the traditional method 
of developing a concept of operations through both written and graphical form. The game 
does not support the development of the COA statement. 

FSC supports training this action item. Overall rating: Good 
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Real World (RW) Preconditions: Mission order has been issued and 
received by the trainee. 

Environment Evaluation 

RW Tasks 

RW Human Abilities 

RW Affordance 
Requirements 

Environment HA 

Environmental 

Affordances 

Level of Support to 
training 

Analyze relative combat 
power (strengths, 
weaknesses) 

COGNITIVE: Written 
Comprehension; 
Deductive Reasoning; 
Inductive Reasoning; 
Problem Sensitivity; 
Mathematical 

Reasoning; Speed of 
Closure; 

SENSORY: 

Near Vision; 

PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity; 

PHYSICAL: 

None 

- See Determine own 
force potential combat 
power 

- See Perform Terrain 
Analysis 

- See Assess Enemy 
Situation 

- See Assess Civil 
Considerations 

COGNITIVE: Written 
Comprehension; 
Deductive Reasoning; 
Inductive Reasoning; 
Problem Sensitivity; 
Mathematical 

Reasoning; Speed of 
Closure; 

SENSORY: 

Near Vision; 

PSYCHOMOTOR: 

Manual Dexterity; 

Einger Dexterity; 

PHYSICAL: 

None 

- See Determine own 
force potential combat 
power 

- See Perform Terrain 
Analysis 

- See Assess Enemy 
Situation 

- See Assess Civil 
Considerations 

5 - Excellent 
*4 - Very Good 

3 - Good 

2 - Eair 

1 - Poor 

Generate Options about 
how to successfully 
execute the mission 

COGNITIVE: Fluencv 
of Ideas; Originality; 
Problem Sensitivity; 
Information Ordering; 
Mathematical 

Reasoning; 

Visualization; Speed of 
Closure; Perceptual 
Speed; Memorization; 

SENSORY: 

Near Vision 

PSYCHOMOTOR: 

Manual Dexterity; 

- See Determine own 
force potential combat 
power 

- See Assess Enemy 
Situation 

- See Perform Terrain 
Analysis 

- See Assess Civil 
Considerations 

- Higher commanders 
intent, desired 
endstate, and critical 
information 
requirements 

COGNITIVE: Written 
Comprehension; 
Deductive Reasoning; 
Inductive Reasoning; 
Problem Sensitivity; 
Mathematical 

Reasoning; Speed of 
Closure; 

SENSORY: 

Near Vision; 

PSYCHOMOTOR: 

Manual Dexterity; 

Linger Dexterity; 

- See Determine own 
force potential combat 
power 

- See Assess Enemy 
Situation 

- See Perform Terrain 
Analysis 

- See Assess Civil 
Considerations 

- Scenario editor that 
allows information to 
be added or deleted 
from OPORD 

5 - Excellent 

4 - Very Good 
*3 - Good 

2 - Eair 

1 - Poor 
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Finger Dexterity; 

PHYSICAL: 

None 


PHYSICAL: 

None 



Array Forces available 

COGNITIVE: 

- See Determine own 

COGNITIVE: Written 

- See Determine own 

*5 - Excellent 

based on the options 

Information Ordering; 

force potential combat 

Comprehension; 

force potential combat 

4 - Very Good 

developed to determine 

Spatial Orientation; 

power 

Deductive Reasoning; 

power 

3 - Good 

troops to task 

Perceptual Speed; 

- Tools (a way) that 

Inductive Reasoning; 

- Game allows trainee 

2 - Fair 


Memorization; 

SENSORY: 

Near Vision; 

PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity; 

PHYSICAL: 

None 

allow the trainee to 
arrange/rearrange and 
assign unit elements to 
meet desired 
objectives 

Problem Sensitivity; 
Mathematical 

Reasoning; Speed of 
Closure; 

SENSORY: 

Near Vision; 

PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity; 

PHYSICAL: 

None 

to assign specific tasks 
to elements based on 
their assets and 
capabilities 

1 - Poor 

Develop a concept of 

COGNITIVE: 

- Tools to develop a 

COGNITIVE: Written 

- As part of the planning 

5 - Excellent 

operations that 

Information Ordering; 

framework that allows 

Comprehension; 

screen under order 

4 - Very Good 

describes how the 

Visualization; 

the trainee to describe 

Inductive Reasoning; 

development the 

*3 - Good 

leader envisions the 

Memorization 

the relationships 

Problem Sensitivity; 

trainee builds (sketch 

2 - Eair 

operation unfolding, 


between activities, 

Mathematical 

out) an OPORD as a 

1 - Poor 

from its start to its 

SENSORY: 

events, and tasks, and 

Reasoning; Speed of 

COA using symbols 


conclusion or end state 

Near Vision; 

PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity 

PHYSICAL: 

None 

explains how the tasks 
will lead to 
accomplishing the 
mission. 

- Tools for the trainee to 
use to physically 
depict or sketch out 
their plan in text or 
pictorial form 

Closure 

SENSORY: 

Near Vision; 

PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity; 

representing tasks that 
may be assigned to 
units by dragging 
them into the unit’s 
box. 
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PHYSICAL: 

None 



Assign responsibilities 
for tasks to subordinate 
elements by name 

COGNITIVE: 

Deductive Reasoning; 
Problem Sensitivity; 
Speed of Closure; 
Perceptual Speed; 
Memorization 

SENSORY: 

Near Vision; Speech 
Clarity 

PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity; 

PHYSICAL: 

None 

- A way to assign or 
annotate specific tasks 
or missions to 
subordinate units by 
name in writing 
(words), verbally or 
using pictures or 
symbols. 

COGNITIVE: Written 
Comprehension; 
Deductive Reasoning; 
Inductive Reasoning; 
Problem Sensitivity; 
Mathematical 

Reasoning; Speed of 
Closure; 

SENSORY: 

Near Vision; 

PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity; 

PHYSICAL: 

None 

- Order development 
screen that allows 
trainee to assign tasks 
to units by dragging 
them into the unit’s 
box 

*5 - Excellent 

4 - Very Good 

3 - Good 

2 - Fair 

1 - Poor 

Prepare a COA 
statement and sketch 
that describes the 
operation 

COGNITIVE: Written 
Expression; Information 
Ordering 

SENSORY: 

Near Vision; 

PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity; 

PHYSICAL: 

None 

Tools to build and 
display a COA 
statement and sketch 
that contains: 

- A decisive point, and 
what makes it decisive 

- A form of maneuver 
or type of defensive 
operation 

- Tasks and purposes of 
the decisive, shaping, 
and sustaining 
operations 

- Reserve planning 
priorities 

- Purposes of critical 

COGNITIVE: Written 
Comprehension; 
Deductive Reasoning; 
Inductive Reasoning; 
Problem Sensitivity; 
Mathematical 

Reasoning; Speed of 
Closure; 

SENSORY: 

Near Vision; 

PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity; 

PHYSICAL: 

None 

- Game only provides 
an orders development 
screen where the 
OPORD is entered in 
graphical form. 

5 - Excellent 

4 - Very Good 

3 - Good 

2 - Fair 
*1 - Poor 
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WFF elements 

- The desired end state 

- A statement that 
describes the COA 




Post-conditions: COA meets the criteria of being suitable, feasible, acceptable, distinguishable, complete 
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Score: 4.00 Very Good 

Action Item: Issue a Fragmentary Order (FRAGO) 

Doctrine: FM 5-0, 3-21.10 

Preconditions: Trainee has developed and issued a plan (WARNO, OPORD) to his unit; 
Original plan requires modifications due to new tactical or operational conditions; 
Elements of order needing adjustment have been identified. 

Task: 

1. Develop a fragmentary order as a result of changes to the original plan 

2. Issue FRAGO verbally 

a. Read FRAGO 

b. Verbally express information 

3. Issue FRAGO as an overlay type order 


Post-conditions: New information has been transmitted from commander to unit; Unit 
elements acknowledge receipt of FRAGO. 


DEFINITION OF SCALE 

5-Excellent - the FTE contains all but a few (90-100%) of the affordances determined 
during the analysis 

4-Very Good - the ITE contains a significant portion (70-89%) of the affordances 
determined during the analysis 

3-Good - the ITE contains a good portion (50-69%) of the affordances determined 
during the analysis 

2-Fair - the ITE contains some (25-49%) of the affordances determined during the 
analysis 

I-Poor - the ITE contains very few (0-24%) of the affordances determined during the 
analysis 

Evaluation Results: 

ESC provides trainees the ability to develop and generate fragmentary orders in response 
to actions encountered in the game that result in the necessity to change the trainee’s 
original plan. FRAGOs are transmitted digitally to artificially intelligent forces that 
execute actions and report. FRAGO orders are not in the doctrinally specified 5- 
paragraph format. 

ESC supports the training of this action item. Overall rating: Very Good 
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Real World (RW) Preconditions: Trainee has developed and issued a plan 
(WARNO, OPORD) to his unit; Original plan requires modifications due to 
new tactical or operational conditions; Elements of order needing adjustment 
have been identified. 

Environment Evaluation 

RW Tasks 

RW Human Abilities 

RW Affordance 
Requirements 

Environment HA 

Environmental 

Affordances 

Level of Support to 
training 

Develop/draft a 5 
paragraph fragmentary 
order to provide 
direction to units in 
contact as a result of 
changes in battlefield 
conditions. 

COGNITIVE: 

Originality; Problem 
Sensitivity; Information 
Ordering; Visualization; 
Speed of Closure 

SENSORY: 

Near Vision 

PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity 

PHYSICAL: 

None 

- Information that 
indicates that a change 
in the original order is 
necessary 

- 5 paragraph 

Fragmentary Order 
Format 

- A way to place 
necessary information 
into the FRAGO 
format (e.g., typed text 
or hand written) 

COGNITIVE: 

Originality; Problem 
Sensitivity; Information 
Ordering; Visualization; 
Speed of Closure 

SENSORY: 

Near Vision 

PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity 

PHYSICAL: 

None 

- Reports of unit contact 
with the enemy 

- Reports of unit 
accomplishment of 
tasks 

- Doctrinal symbols 
representing tasks 

- Screen that contains 
task symbols and unit 
icon representations 
that allows tasks to be 
dragged and dropped 
onto units 

5 - Excellent 
*4 - Very Good 

3 - Good 

2 - Fair 

1 - Poor 

Issue FRAGO verbally 

- Read FRAGO 

- Verbally Express 
information 

COGNITIVE: 

Written 

Comprehension; Oral 
Expression 

SENSORY: 

Near Vision; Speech 
Clarity 

PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity 

PHYSICAL: 

None 

- FRAGO in a written 
form 

- A means to amplify 
the voice so that 
transmission of the 
FRAGO may occur if 
the audience is not 
within hearing range 
(e.g., radio) 

- Audience for receipt of 
order 

COGNITIVE: 

None 

SENSORY: 

Near Vision; 

PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity 

PHYSICAL: 

None 

- Simulated unit 

- No means to verbally 
transmit information 

5 - Excellent 

4 - Very Good 
*3 - Good 

2 - Fair 

1 - Poor 

** This item would be 
rated as Poor if tasks 
were not considered 
equally important. 

Issue FRAGO digitally 

COGNITIVE: 

- A way to digitally 

COGNITIVE: 

- Simulated digital 

*5 - Excellent 
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Information Ordering; 

deliver or transmit the 

Written 

transmission of 

4 - Very Good 


Spatial Orientation; 

order (e.g., mission 

Comprehension; Oral 

ERAGO information 

3 - Good 



command system) 

Expression 

to unit 

2 - Eair 


SENSORY: 

- Audience to receive 


- Simulated unit 

1 - Poor 


Depth Perception; Near 

order 

SENSORY: 




Vision 


Near Vision 




PSYCHOMOTOR: 


PSYCHOMOTOR: 




Arm-Hand Steadiness; 


Manual Dexterity; 




Manual Dexterity; 

Finger Dexterity 


Einger Dexterity 






PHYSICAL: 




PHYSICAL: 

Extent Flexibility 


None 



Post-conditions: New information has been transmitted from commander to unit; Unit elements acknowledge receipt of FRAGO. 
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APPENDIX F. REVISED ANALYSIS OF ESC 


The following pages provide the re-analysis of FSC with the revised 4 point 
ITEAM Scale. 


Action Item: Analyze the Enemy Situation Good 3.00 

Doctrine: FM 3-21.8, 3-21.10, 5-0 

Preconditions: Trainee has knowledge of enemy doctrine and weapons capabilities; 
Trainee receives information from his higher headquarters including an enemy situational 
template (SITTEMP), current intelligence assumptions regarding enemy capabilities (i.e., 
composition, disposition, strength and recent activities); Trainee has conducted an 
analysis of the terrain and weather conditions within the area of interest and area of 
operations. 

Task: Analyze the Enemy Situation 

1. Trainee processes all provided information about the enemy capabilities with his own 

knowledge of and experience with the threat. 

2. Trainee reviews the current enemy situational template depicting the disposition of 

forces 

3. Trainee considers the enemy intelligence information in conjunction with the terrain 

and weather data provided 

4. Trainee repeats steps 1-3 as new information becomes available. 

Post-conditions: Trainee has understanding of current enemy situation; Trainee has 
insight into possible future enemy courses of action 


DEFINITION OF SCALE 

4-Very Good —the ITE contains a significant portion (75-100%) of the affordances 
determined during the initial analysis 

3-Good —the ITE contains a good portion (50-74%) of the affordances determined 
during the initial analysis 

2-Fair —the ITE contains some (25-49%) of the affordances determined during the 
initial analysis 

I-Poor —the ITE contains very few (0-24%) of the affordances determined during the 
initial analysis 
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Real World (RW) Preconditions: 

Trainee has knowledge of enemy doctrine and weapons capabilities; 

Trainee receives information from his higher headquarters including an 
enemy situational template (SITTEMP), current intelligence assumptions 
regarding enemy capabilities (i.e., composition, disposition, strength and 
recent activities); 

Trainee receives current information about weather and terrain conditions 
within the area of interest and area of operations 

Environment Evaluation 

Enemy situational template is not provided by the system. 

RW Tasks 

RW Human Abilities 

RW Affordance 
Requirements 

Environment HA 

Environmental 

Affordances 

Level of Support to 
Training 

Trainee processes the 
information provided to 
him about the enemy 
with his own 
knowledge of and 
experience with the 
threat 

COGNITIVE: 

Oral comprehension; 
Written 

comprehension; 

Inductive Reasoning; 
Problem Sensitivity; 
Spatial Orientation; 

Speed of Closure; 
Memorization 

SENSORY: 

Near Vision 

PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity 

PHYSICAL: 

None 

- Composition and 
strength of enemy 
force 

- Enemy most likely 
course of action 

- Enemy weapons 
capabilities 

- Current and probable 
locations of enemy 
forces 

- Recent enemy activity 
in the area 

- Any tools necessary 
to annotate, arrange or 
depict information for 
analysis (e.g., acetate, 
map, alcohol pens, 
written order, paper, 
pencil, mission 
command systems) 

COGNITIVE: 

Oral comprehension; 
Written 

comprehension; 

Inductive Reasoning; 
Problem Sensitivity; 
Speed of Closure; 
Memorization 

SENSORY: 

Near Vision 

PSYCHOMOTOR: 

Manual Dexterity, 

Finger Dexterity 

PHYSICAL: 

None 

- Scenario editor allows 
for enemy 
information to be 
included as part of the 
operations order 

*4 - Very Good 

3 - Good 

2 - Fair 

1 - Poor 

Trainee reviews the 
enemy situational 
template 

COGNITIVE: 

Speed of Closure; 
Inductive Reasoning; 
Deductive Reasoning; 
Problem Sensitivity 

- Enemy Situational 
Template 

- Map of operational 
area with appropriate 
graphics and symbols 
represented 

COGNITIVE: 

Speed of Closure; 
Inductive Reasoning; 
Deductive Reasoning; 
Problem Sensitivity 

- Enemy Situational 
template not provided 

4 - Very Good 

3 - Good 

2 - Fair 
*1 - Poor 
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SENSORY: 

Near vision; 

PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity 

PHYSICAL: None 

- Any mission 
command systems 
that are used to assist 
in organizing or 
analyzing enemy 
information 

- See perform terrain 
analysis 

SENSORY: 

Near Vision 

PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity 

PHYSICAL: None 



Trainee considers 

COGNITIVE: 

- Light and weather 

COGNITIVE: 

- Scenario editor allows 

*4 - Very Good 

enemy information in 

Deductive Reasoning; 

data 

Deductive Reasoning; 

for the inclusion of 

3 - Good 

conjunction with terrain 

Inductive Reasoning; 

- Information about 

Inductive Reasoning; 

Terrain and Weather 

2 - Fair 

and weather data 

Problem Sensitivity; 
Speed of Closure; 
Memorization 

SENSORY: 

None 

PSYCHOMOTOR: 

None 

PHYSICAL: 

None 

terrain and weather 
from previous 
analysis. (See perform 
terrain analysis) 

- Enemy information 
from step 1 (i.e., 
disposition, 
composition, 
suspected locations, 
likely actions) 

Problem Sensitivity; 
Speed of Closure; 
Memorization 

SENSORY: 

None 

PSYCHOMOTOR: 

None 

PHYSICAL: 

None 

data as part of the 
battalion operations 
order. 

1 - Poor 

Post-conditions: Trainee has understanding of current enemy situation; Trainee has insight into possible future enemy courses of action 
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Score: Very Good 4.00 


Action Item: Perform Terrain Analysis 
Doctrine: FM 5-0, 3-21.10 

Preconditions: Trainee has been issued a mission order and understands his AO and AI; 
Trainee is fa mi liar with troop leading procedures, mission analysis and METT-TC; 
Trainee has conducted steps 1 and 2 of the troop leading procedures 

Task: Conduct a terrain analysis from a map and materials provided by the higher 
headquarters using the acronym OAKOC (Obstacles, Avenues of Approach, Key 
Terrain, Observation and Fields of Fire, Cover and Concealment). 

Post-conditions: Terrain Analysis answers the question; What is the terrain’s effect on 
the operation?; Graphical Display of the Terrain (GDOT) produced 


DEFINITION OF SCALE 

4-Very Good —the ITE contains a significant portion (75-100%) of the affordances 
determined during the initial analysis 

3-Good —the ITE contains a good portion (50-74%) of the affordances determined 
during the initial analysis 

2-Fair —the ITE contains some (25-49%) of the affordances determined during the 
initial analysis 

I-Poor —the ITE contains very few (0-24%) of the affordances determined during the 
initial analysis 
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Real World (RW) Preconditions: 

Trainee has been issued a mission order and understands his AO and AI; 

Trainee is familiar with troop leading procedures, mission analysis and METT- 
TC; Trainee has conducted steps 1 and 2 of the troop leading procedures 

Environment Evaluation 

RW Tasks 

RW Human Abilities 

RW Affordance 
Requirements 

Environment HA 

Environmental 

Affordances 

Level of Support to 
training 

Conduct a terrain 
analysis from a map and 
materials provided by 
the higher headquarters 
using the acronym 
OAKOC (Obstacles, 
Avenues of Approach, 
Key Terrain, 

Observation and Fields 
of Fire, Cover and 
Concealment). 

COGNITIVE: Written 
Comprehension; 
Deductive Reasoning; 
Inductive Reasoning; 
Problem Sensitivity; 
Visualization; Spatial 
Orientation; 

Memorization 

SENSORY: 

Near Vision; Visual 

Color Discrimination; 

PSYCHOMOTOR: 

Arm-Hand Steadiness; 
Manual Dexterity; 

Finger Dexterity; 

PHYSICAL: 

None 

- Paragraph 1 of 

OPORD that provides 
information from 
higher headquarters 
about the terrain and 
weather. 

- Maneuver Combined 
Obstacle Overlay from 
higher headquarters 

- Representation of the 
terrain that the trainee 
will maneuver over 
(e.g., map, aerial 
photographs) 

- Intelligence 
information about 
enemy emplaced, 
natural or man-made 
obstacles known by 
the higher 
headquarters 

COGNITIVE: 

SENSORY: 

Near Vision; Visual 

Color Discrimination; 

PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity; 

PHYSICAL: 

None 

- Scenario editor allows 
for as much or as little 
detail as desired in 
paragraph 1 of the 
OPORD. 

- Scenario editor allows 
maps and simulated 
photography to be 
provided in the 
scenario. 

- No MCOO 
functionality exists in 
the game 

*4 - Very Good 

3 - Good 

2 - Fair 

1 - Poor 

Trainee repeats analysis 
as necessary to maintain 
a current assessment 






Post-conditions: 

Answer provided to question; What is the terrain’s effect on the operation?; Graphical Terrain Analysis Overlay (GTAO) developed 
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Score: Fair 2.00 


Action Item: Conduct an AAR 
Doctrine: TC 25-20; AR 11-13 

Preconditions: Mission or exercise has concluded or been stopped; Type/Format of 
AAR decided. 

Task: Conduct an AAR 

Post-conditions: Trainee has a better understanding of events and how his actions 
influenced mission outcomes. 


DEFINITION OF SCALE 

4-Very Good —the ITE contains a significant portion (75-100%) of the affordances 
determined during the initial analysis 

3-Good —the ITE contains a good portion (50-74%) of the affordances determined 
during the initial analysis 

2-Fair —the ITE contains some (25-49%) of the affordances determined during the 
initial analysis 

I-Poor —the ITE contains very few (0-24%) of the affordances determined during the 
initial analysis 
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Real World (RW) Preconditions: Mission or exercise has concluded or been 
stopped; Type/Format of AAR decided 

Environment Evaluation 

RW Tasks 

RW Human Abilities 

RW Affordance 
Requirements 

Environment HA 

Environmental 

Affordances 

Level of support to 
training 

Conduct an AAR; 

- During or immediately 
after each event 

- Focus on intended 
training objectives 

- Focus on soldier, 
leader and unit 
performance 

- Involve all participants 
in the discussion. 

- Use open-ended 
questions. 

- Are related to specific 
standards. 

- Determine strengths 
and weaknesses. 

- Link performance to 
subsequent training. 

COGNITIVE: 

Oral Expression; Oral 
Comprehension; 

Deductive Reasoning; 
Fluency of Ideas; 

Inductive Reasoning; 
Problem Sensitivity; 
Information Ordering; 
Visualization; Speed of 
Closure; Perceptual 

Speed 

SENSORY: 

Near Vision; Visual 

Color Discrimination; 
Speech Clarity; Speech 
Recognition; 

PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity; 

Reaction Time; 

PHYSICAL: Stamina; 
Gross Body Equilibrium 

- A way to identify, 
recreate or represent 
significant events that 
occurred during 
training 

- Representation or 
replication of trainee 
performance at 
identified key points in 
training 

- A Eacilitator 

- Training Audience 

- Training Objectives 

- Doctrinal 
references/info 

COGNITIVE: 

Inductive Reasoning; 
Problem Sensitivity; 
Information Ordering; 
Speed of Closure; 
Perceptual Speed 

SENSORY: 

Near Vision; Visual 

Color Discrimination; 

PSYCHOMOTOR: 

Manual Dexterity; 

Einger Dexterity; 

PHYSICAL: 

None 

- Recording of mission 

- Statistics dealing with 
weapon use (e.g., 
mortars, grenade, 
satchel charges and 
javelins) 

- Weapon distributions 
and ammo expenditure 

- Casualties 

- Blue force plan 

OPORD 

- Red force plan 

- Review screen that 
allows players to view 
operation and stop at 
decision points to view 
specific events 

- Explainable AI that 
allows preformatted 
questions to be asked 
of Soldiers to 
determine what was 
going on at that time. 

4 - Very Good 

3 - Good 
*2 - Eair 

1 - Poor 

Post-conditions: 

Trainee has a better understanding of events and how his actions influenced mission outcomes. 
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Score: Good 3.00 


Action Item(s): 

Synchronize a light company team attack in an urban operation 
Synchronize the engineer portion of a light infantry company attack 
Synchronize the indirect fires portion of a light infantry company attack 

Doctrine: FM 3-21.10 

Preconditions: Trainee has received a mission order; Trainee has knowledge of doctrine 
dealing with offensive and urban operations; Trainee has knowledge about how to plan 
indirect fires and breaching operations. 

Task (s): 

1. Integrate the following to develop a course of action: 

Apply selected steps of the Troop Leading Procedures (Partially Evaluated) 
Conduct Mission Analysis (Partially evaluated) 

Analyze civil considerations (Evaluated) 

Analyze enemy situation (Evaluated) 

Perform terrain analysis (Evaluated) 

Develop a course of action for a light infantry company (Evaluated) 

Conduct Reconnaissance (Evaluated) 

Determine own force potential (Evaluated) 

Integrate the fundamentals of the offense into a COA (Evaluated) 

Integrate fire support into urban operations (Evaluated) 

Plan breaching operations (Evaluated) 

Select a COA (Evaluated) 

Issue a ERA GO (Evaluated) 

2. Command and control the execution of the plan. 

Post-conditions: Plan is developed and actions are synchronized; Plan is executed and 
adjustments are made based on changing battlefield conditions 


DEFINITION OF SCALE 

4-Very Good —the ITE contains a significant portion (75-100%) of the affordances 
determined during the initial analysis 

3-Good —the ITE contains a good portion (50-74%) of the affordances determined 
during the initial analysis 
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2-Fair —the ITE contains some (25-49%) of the affordances determined during the 
initial analysis 

1-Poor —the ITE contains very few (0-24%) of the affordances determined during the 
initial analysis 
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Real World (RW) Preconditions: Trainee has received a mission order; 
Trainee has knowledge of doctrine dealing with offensive and urban 
operations; Trainee has knowledge about how to plan indirect fires and 
breaching operations 

Environment Evaluation 

RW Tasks 

RW Human Abilities 

RW Affordance 
Requirements 

Environment HA 

Environmental 

Affordances 

Level of Support to 
Training 

Apply selected troop 
leading procedures 

See apply selected 
troop leading 
procedures 

See apply selected 
troop leading 
procedures 

See apply selected 
troop leading 
procedures 

See apply selected 
troop leading 
procedures 

4 - Very Good 

3 - Good 
*2 - Fair 

1 - Poor 

Conduct Mission 

Analysis 

See conduct mission 
analysis 

See conduct mission 
analysis 

See conduct mission 
analysis 

See conduct mission 
analysis 

4 - Very Good 
*3 - Good 

2 - Fair 

1 - Poor 

Analyze civil 
considerations 

See analyze civil 
considerations 

See analyze civil 
considerations 

See analyze civil 
considerations 

See analyze civil 
considerations 

4 - Very Good 

3 - Good 
*2 - Fair 

1 - Poor 

Analyze enemy 
situation 

See analyze enemy 
situation 

See analyze enemy 
situation 

See analyze enemy 
situation 

See analyze enemy 
situation 

4 - Very Good 
*3 - Good 

2 - Fair 

1 - Poor 

Perform terrain analysis 

See perform terrain 
analysis 

See perform terrain 
analysis 

See perform terrain 
analysis 

See perform terrain 
analysis 

*4 - Very Good 

3 - Good 

2 - Fair 

1 - Poor 

Develop a course of 
action for a light 
infantry company 

See develop a light 
infantry company 
course of action 

See develop a light 
infantry company 
course of action 

See develop a light 
infantry company 
course of action 

See develop a light 
infantry company 
course of action 

4 - Very Good 
*3 - Good 

2 - Fair 

1 - Poor 

Conduct 

Reconnaissance 

See conduct 
reconnaissance 

See conduct 
reconnaissance 

See conduct 
reconnaissance 

See conduct 
reconnaissance 

4 - Very Good 

3 - Good 
*2 - Fair 

1 - Poor 

Determine own force 
potential 

See determine own 
force potential combat 
power 

See determine own 
force potential combat 
power 

See determine own 
force potential combat 
power 

See determine own 
force potential combat 
power 

*4 - Very Good 

3 - Good 

2 - Fair 
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1 - Poor 

Integrate the 
fundamentals of the 
offense into a COA 

See integrate the 
fundamentals of the 
offense into a COA 

See integrate the 
fundamentals of the 
offense into a COA 

See integrate the 
fundamentals of the 
offense into a COA 

See integrate the 
fundamentals of the 
offense into a COA 

4 - Very Good 
*3 - Good 

2 - Fair 

1 - Poor 

Integrate fire support 
into urban operations 

See integrate fire 
support into urban 
operations 

See integrate fire 
support into urban 
operations 

See integrate fire 
support into urban 
operations 

See integrate fire 
support into urban 
operations 

4 - Very Good 
*3 - Good 

2 - Fair 

1 - Poor 

Plan breaching 
operations 

See plan breaching 
operations 

See plan breaching 
operations 

See plan breaching 
operations 

See plan breaching 
operations 

4 - Very Good 
*3 - Good 

2 - Fair 

1 - Poor 

Select a COA 

See select a course of 
action 

See select a course of 
action 

See select a course of 
action 

See select a course of 
action 

4 - Very Good 
*3 - Good 

2 - Fair 

1 - Poor 

Issue a FRAGO 

See issue a FRAGO 

See issue a FRAGO 

See issue a FRAGO 

See issue a FRAGO 

4 - Very Good 
*3 - Good 

2 - Fair 

1 - Poor 

Command and Control 
Execution (Supervise) 

COGNITIVE: 

Oral Expression; Oral 
Comprehension; 

Written 

Comprehension; 
Deductive Reasoning; 
Fluency of Ideas; 
Inductive Reasoning; 
Originality; Problem 
Sensitivity; Information 
Ordering; Mathematical 
Reasoning; 

Visualization; Spatial 
Orientation; Speed of 
Closure; Perceptual 
Speed; Memorization; 

- Elements to command 
and a tactical scenario 
in which to control 
them. 

- Scenario providing 
representations of the 
higher commander, 
the enemy, the 
physical environment 
and the enemy. 

- The environment 
should afford radio 
communications 
between the trainee, 
his unit elements and 
his higher 

COGNITIVE: 

Oral Comprehension; 
Written 

Comprehension; 
Deductive Reasoning; 
Inductive Reasoning; 
Problem Sensitivity; 
Information Ordering; 
Visualization; Spatial 
Orientation; Speed of 
Closure; Memorization; 
Time Sharing; 

SENSORY: 

Near Vision; Visual 

Color Discrimination 

- AI Unit 

- Higher HQ 

- Game acts as mission 
command system 
during execution 

- Tactical scenario 

- Interaction through 
scripted messages, 
simulated radio traffic 
and FRAGO orders 

- FRAGO capability 

*4 - Very Good 

3 - Good 

2 - Fair 

1 - Poor 
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Selective Attention; 

headquarters. 



Time Sharing; 

- The environment 

PSYCHOMOTOR: 



should afford 

Manual Dexterity; 


SENSORY: 

interaction between 

Pinger Dexterity; 


Night Vision; 

the trainee, his 



Peripheral Vision; 

subordinate elements, 

PHYSICAL: None 


Glare Sensitivity; 

his higher 



Depth Perception; Far 

headquarters and the 



Vision; Near Vision; 

enemy. 



Visual Color 

- Environment should 



Discrimination; 

afford the trainee a 



Auditory Attention; 

way to adjust his plan 



Speech Clarity; Speech 

and issue new orders 



Recognition; Hearing 

during the scenario as 



Sensitivity; Sound 
Localization; 

in real life. 



PSYCHOMOTOR: 

Arm-Hand Steadiness; 
Manual Dexterity; 

Finger Dexterity; 

Control Precision; 
Response Orientation; 
Rate Control; 

Multilimb 

Coordination; 




PHYSICAL: 

Explosive Strength; 
Trunk Strength; 

Stamina; Extent 
Elexibility; Gross Body 
Coordination; Gross 

Body Equilibrium 





Post-conditions: 

Plan is developed and actions are synchronized; Plan is executed and adjustments are made based on changing battlefield conditions 
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Score: Very Good 4.00 

Action Item: Determine own force potential combat power 
Doctrine: FM 3-21.10 

Preconditions: Trainees receive a mission order and a task organization for execution of 
the mission for their unit. 

Task: Determine force combat power: Identify all available organic and non-organic unit 
assets available to determine the unit’s strength, composition and capabilities. 

Post-conditions: Trainees have an understanding of the composition, strength and 
capabilities of all assets available to them for their assigned mission. 


DEFINITION OF SCALE 

4-Very Good —the ITE contains a significant portion (75-100%) of the affordances 
determined during the initial analysis 

3-Good —the ITE contains a good portion (50-74%) of the affordances determined 
during the initial analysis 

2-Fair —the ITE contains some (25-49%) of the affordances determined during the 
initial analysis 

I-Poor —the ITE contains very few (0-24%) of the affordances determined during the 
initial analysis 


245 



Real World (RW) Preconditions: 

Trainee receives a mission order and a task organization for execution of the 
mission for his unit. 

Environmental Evaluation 

RW Tasks 

RW Human Abilities 

RW Affordance 
Requirements 

Environment HA 

Environmental 

Affordances 

Level of support to 
training 

Trainees identify all 
available organic and 
non-organic assets 
available to them to 
determine their unit’s 
strength, composition 
and capabilities. 

COGNITIVE: 

Written 

Comprehension; Oral 
Comprehension; 
Inductive Reasoning; 
Problem Sensitivity; 
Mathematical 

Reasoning; 

Visualization; 

Perceptual Speed; 
Memorization; 

SENSORY: 

Near Vision; Speech 
Recognition 

PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity; 

PHYSICAL: 

None 

- Information about 
available assets for the 
trainee to use to 
accomplish his 
mission. 

- Information about 
strengths and 
weaknesses of unit 
equipment and 
personnel. 

- Friendly weapons 
capabilities, status and 
number 

- Tools that assist the 
trainee in annotating, 
arranging or depicting 
own unit information 
for analysis (e.g., 
acetate, map, alcohol 
pens, written order, 
paper, pencil, 
computer screens) 

COGNITIVE: 

Written 

Comprehension; 
Inductive Reasoning; 
Problem Sensitivity; 
Mathematical 

Reasoning; 

Memorization; 

SENSORY: 

Near Vision; 

PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity; 

PHYSICAL: 

None 

- Task organization for 
trainee’s unit 

- Notification of 
additional assets 
provided to support 
trainee 

- Scenario editor that 
allows the trainer to 
increase or decrease 
the amount of 
information about the 
unit or attachments 
depending on the 
intent of the training. 

*4 - Very Good 

3 - Good 

2 - Fair 

1 - Poor 

Post-conditions: 

Trainee has an understanding of the composition, strength and capabilities of all assets available to him for his assigned mission. 
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Score: Good 3.00 


Action Item: Select a Course of Action (COA) 

Doctrine: FM 3-21.10, 5-0 

Preconditions: Trainee is familiar with the troop leading procedures; Trainee is familiar 
with the execution of mission analysis and course of action development; Trainee has 
developed at least 2 courses of action; All courses of action have been evaluated for their 
suitability, completeness, feasibility, distinctness and completeness. 

Task: Select a COA that meets the requirements of the battalion commander's intent, 
achieves the company's purpose, maximizes the effects of terrain, minimizes casualties, 
and is within the company's capabilities. 

Post-conditions: Best COA is selected from available alternatives that satisfies the need 
and operational conditions 


DEFINITION OF SCALE 

4-Very Good —the ITE contains a significant portion (75-100%) of the affordances 
determined during the initial analysis 

3-Good —the ITE contains a good portion (50-74%) of the affordances determined 
during the initial analysis 

2-Fair —the ITE contains some (25-49%) of the affordances determined during the 
initial analysis 

I-Poor —the ITE contains very few (0-24%) of the affordances determined during the 
initial analysis 


**Note: EM 3-21.10 states that at the company level only one COA is usually generated. 
At higher levels more that one course of action is developed and compared making the 
selection process a more formal one. 
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Real World (RW) Preconditions: Trainee is familiar with the troop leading 
procedures; Trainee is familiar with the execution of mission analysis and 
course of action development; Trainee has developed at least 2 courses of 
action; All courses of action have been evaluated for their suitability, 
completeness, feasibility, distinctness and completeness 

Environment Evaluation 

System allows for the development of only 1 COA that is the operations order 
that is issued to the unit. 

Tasks 

Human Abilities 

Affordance 

Requirements 

Environment HA 

Environmental 

Affordances 

Level of Support to 
training 

Select a course of action 

COGNITIVE: 

Deductive Reasoning; 
Problem Sensitivity 

SENSORY: 

Near Vision 

PSYCHOMOTOR: 

None 

PHYSICAL: 

None 

- A course of action that 
has been developed. 

- A means to physically 
select or annotate 
selection of one COA 

COGNITIVE: 

Deductive Reasoning; 
Problem Sensitivity 

SENSORY: 

Near Vision 

PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity 

PHYSICAL: 

None 

- The ability to develop 
an operations order 
that contains a course 
of action that is issued 
to the unit for 
execution. 

4 - Very Good 
*3 - Good 

2 - Fair 

1 - Poor 

**This item should be 
rated as Poor because 
the system does not 
allow the development 
and selection of a COA 
separate from the 
development of the 
operations order. 

Post-conditions: Best COA is selected from available alternatives that satisfies the need and operational conditions 
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Score: Good 2.63 


Action Item: Apply Selected Troop Leading Procedures 
Doctrine: FM 3-21.10, 5-0 

Preconditions: Headquarters has issued a mission type order. 

Tasks: 

1. Receive the mission and conduct analysis of its contents 

2. Issue a warning order to unit to allow them to begin parallel planning 

3. Make a tentative Plan that will be the basis for the OPORD 

4. Initiate movement of unit elements so that they may be prepared for initiation of the 
mission 

5. Reconnoiter in support of plan development 

6. Complete the plan and develop the OPORD 

7. Issue OPORD 

8. Supervise execution of OPORD 

Post-conditions: Trainee understands higher commanders mission and intent; Trainee 
understands the threat and higher commanders CCIR; Trainee develops a plan for his unit 
that has taken account of specified, implied and critical tasks necessary to fulfill the 
higher headquarters mission; Trainee issues his mission order to his unit elements and 
controls it’s execution; Trainee exercises command. 

DEFINITION OF SCALE 

4-Very Good —the ITE contains a significant portion (75-100%) of the affordances 
determined during the initial analysis 

3-Good —the ITE contains a good portion (50-74%) of the affordances determined 
during the initial analysis 

2-Fair —the ITE contains some (25-49%) of the affordances determined during the 
initial analysis 

I-Poor —the ITE contains very few (0-24%) of the affordances determined during the 
initial analysis 
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Real World (RW) Preconditions: Higher Headquarters has issued a mission 
type order 

Environment Evaluation 

Tasks 

Human Abilities 

Affordance 

Requirements 

Environment HA 

Environmental 

Affordances 

Level of Support to 
training 

Receive the mission 
and conduct analysis of 
its contents 

COGNITIVE: 

Oral Comprehension; 
Written 

Comprehension; 
Deductive Reasoning; 
Inductive Reasoning; 
Visualization; Spatial 
Orientation; Selective 
Attention; Time 

Sharing; 

SENSORY: 

Near Vision; Auditory 
Attention 

PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity 

PHYSICAL: None 

- Higher headquarters 
mission and 
commanders intent 

- See assess enemy 
situation 

- See perform terrain 
analysis 

- See determine own 
force potential combat 
power 

- A means to develop a 
timeline and keep 
track of time available 
for planning 

COGNITIVE: 

Written 

Comprehension; 
Deductive Reasoning; 
Inductive Reasoning; 
Visualization; Spatial 
Orientation 

SENSORY: 

Near Vision 

PSYCHOMOTOR: 

Manual Dexterity; 

Einger Dexterity 

PHYSICAL: 

None 

- System scenario 
development tool 
allows for as much or 
as little information 
about the mission to 
be provided to the 
trainee. 

- System provides the 
option of changing the 
amount of available 
time to complete the 
mission but does not 
have a timeline tool or 
representation 

4 - Very Good 
*3 - Good 

2 - Eair 

1 - Poor 

Issue a warning order to 
unit to allow them to 
begin parallel planning 

COGNITIVE: 

Oral Expression; 

Written Expression; 

SENSORY: 

Near Vision; Speech 
Clarity; 

PSYCHOMOTOR: 

Manual Dexterity; 

Einger Dexterity; 

PHYSICAL: 

- Audience to issue 
order too 

- Ability to develop a 
warning order 

- Warning order format 

- A means of 
transferring the 
information to the 
audience if other than 
verbally (e.g., mission 
command system). 

COGNITIVE: 

None 

SENSORY: 

Near Vision 

PSYCHOMOTOR: 

Manual Dexterity; 

Einger Dexterity 

PHYSICAL: 

None 

- Audience of 
artificially intelligent 
avatars that execute 
instructions 

- A way to transmit the 
order 

- No warning order 
functionality present 
in the game. 

4 - Very Good 
*3 - Good 

2 - Eair 

1 - Poor 

**This item would be 
rated as Poor if tasks 
were not considered 
equally important. Not 
having a warning order 
to issue makes this task 
un trainable. 
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None 





Make a tentative Plan 

COGNITIVE: 

- See develop a light 

COGNITIVE: 

- See develop a light 

4 - Very Good 

that will be the basis for 

Written 

infantry COA 

Written 

infantry COA 

*3 - Good 

the OPORD 

Comprehension; 

- See conduct mission 

Comprehension; 

- See conduct mission 

2 - Fair 


Written Expression; 

analysis 

Deductive Reasoning; 

analysis 

1 - Poor 


Deductive Reasoning; 


Inductive Reasoning; 




Fluency of Ideas; 


Originality; Problem 




Inductive Reasoning; 


Sensitivity; Information 




Originality; Problem 


Ordering; 




Sensitivity; Information 


Visualization; Speed of 




Ordering; Mathematical 


Closure; Memorization; 




Reasoning; Number 
Facility; Visualization; 


Time Sharing; 




Spatial Orientation; 


SENSORY: 




Speed of Closure; 
Perceptual Speed; 


Near Vision; 




Memorization; 


PSYCHOMOTOR: 




Selective Attention; 


Manual Dexterity; 




Time Sharing; 


Finger Dexterity; 




SENSORY: 


PHYSICAL: 




Near Vision; 


None 




PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity; 






PHYSICAL: 

None 





Initiate movement of 

COGNITIVE: 

- Environment must 

COGNITIVE: 

- Settings within the 

4 - Very Good 

unit elements so that 

Oral Expression; 

provide the trainee the 

Written Expression; 

scenario allow the 

3 - Good 

they may be prepared 

Written Expression; 

ability to initiate 

Problem Sensitivity; 

opposing force to 

*2 - Fair 

the mission 

Problem Sensitivity; 

movement of his 


move during planning 

1 - Poor 


Spatial Orientation; 

forces in preparation 

SENSORY: 

but not friendly forces 




for plan execution 

Near Vision 

- No WARNO 



SENSORY: 

prior to OPORD 


capability 



Speech Clarity; 

issuance (e.g., move 

PSYCHOMOTOR: 

- Game acts as mission 



251 






PSYCHOMOTOR: 

Arm-Hand Steadiness; 
Manual Dexterity; 

Finger Dexterity; 

PHYSICAL: 

Dynamic Strength; 

Extent Flexibility; 

Gross Body 

Coordination; Gross 

Body Equilibrium 

vehicles to staging 
point, conduct 
reconnaissance, 
conduct rehearsals) 

- Ability to develop 
Warning type orders 

- A means to transmit 
orders (e.g., mission 
command system, 
radio) 

Manual Dexterity; 

Finger Dexterity; 

PHYSICAL: 

None 

command system 


Reconnoiter in support 
of plan development 

- See Conduct 
Reconnaissance 

- See Conduct 
Reconnaissance 

- See Conduct 
Reconnaissance 

- See Conduct 
Reconnaissance 

4 - Very Good 
*3 - Good 

2 - Fair 

1 - Poor 

Complete the plan and 
develop the OPORD 

COGNITIVE: 

Oral Comprehension; 
Written Expression; 
Deductive Reasoning; 
Inductive Reasoning; 
Originality; Problem 
Sensitivity; Information 
Ordering; Mathematical 
Reasoning; 

Visualization; Spatial 
Orientation; Speed of 
Closure; Perceptual 
Speed; Memorization; 
Selective Attention; 

Time Sharing; 

SENSORY: 

Near Vision; Auditory 
Attention; Speech 
Recognition; 

- See assess civil 
considerations 

- Outputs or pieces of 
necessary information 
from previous steps of 
the mission analysis 
and troop leading 
processes 

- Pieces of the 
operations order or 
plan that are to be 
combined together to 
make up the plan of 
action 

COGNITIVE: 

Written Expression; 
Deductive Reasoning; 
Inductive Reasoning; 
Originality; Problem 
Sensitivity; Information 
Ordering; 

Visualization; Speed of 
Closure; Memorization; 
Time Sharing; 

SENSORY: 

Near Vision; 

PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity; 

PHYSICAL: 

None 

- See assess civil 
considerations 

- Higher HQ OPORD 
and intelligence 
information 

4 - Very Good 

3 - Good 
*2 - Fair 

1 - Poor 
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PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity; 

PHYSICAL: 

None 





Issue OPORD 

COGNITIVE: 

Oral Expression; 

Written Expression; 

SENSORY: 

Near Vision; Speech 
Recognition; 

PSYCHOMOTOR: 

Manual Dexterity; 

Einger Dexterity; 

PHYSICAL: 

None 

- See issue infantry 
company or company- 
team operations order 

COGNITIVE: 

Written Expression 

SENSORY: 

Near Vision; 

PSYCHOMOTOR: 

Manual Dexterity; 

Einger Dexterity; 

PHYSICAL: 

None 

- See issue infantry 
company or company- 
team operations order 

4 - Very Good 

3 - Good 
*2 - Eair 

1 - Poor 

Supervise execution of 
the OPORD 

COGNITIVE: 

Oral Expression; Oral 
Comprehension; 

Written 

Comprehension; 
Deductive Reasoning; 
Eluency of Ideas; 
Inductive Reasoning; 
Originality; Problem 
Sensitivity; Information 
Ordering; Mathematical 
Reasoning; 

Visualization; Spatial 
Orientation; Speed of 
Closure; Perceptual 
Speed; Memorization; 
Selective Attention; 

- Elements to command 
and a tactical scenario 
in which to control 
them. 

- Any mission 
command systems 
available and 
normally used in the 
act of commanding or 
controlling a tactical 
plan 

- Scenario providing 
representations of the 
higher commander, 
the enemy, the 
physical environment 
and the enemy. 

COGNITIVE: 

Oral Comprehension; 
Written 

Comprehension; 
Deductive Reasoning; 
Inductive Reasoning; 
Problem Sensitivity; 
Information Ordering; 
Visualization; Spatial 
Orientation; Speed of 
Closure; Memorization; 
Time Sharing; 

SENSORY: 

Near Vision; Visual 

Color Discrimination 

- AI Unit 

- Higher HQ 

- Game acts as mission 
command system 
during execution 

- Tactical scenario 

- Interaction through 
scripted messages, 
simulated radio traffic 
and ERAGO orders 

- ERAGO capability 

*4 - Very Good 

3 - Good 

2 - Pair 

1 - Poor 
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Time Sharing; 

- The environment 

PSYCHOMOTOR: 



should provide a way 

Manual Dexterity; 


SENSORY: 

for the trainee to 

Einger Dexterity; 


Night Vision; 

interact with his 



Peripheral Vision; 

subordinate elements, 

PHYSICAL: 


Glare Sensitivity; 

his higher 

None 


Depth Perception; Far 

headquarters and the 



Vision; Near Vision; 

enemy (i.e.. 



Visual Color 

communicate, signal. 



Discrimination; 

attack, etc.) 



Auditory Attention; 

- Environment should 



Speech Clarity; Speech 

provide a means for 



Recognition; Hearing 

the trainee a way to 



Sensitivity; Sound 

adjust his plan and 



Localization; 

issue new orders 
during the scenario as 



PSYCHOMOTOR: 

in real life (See issue a 



Arm-Hand Steadiness; 
Manual Dexterity; 

Finger Dexterity; 

Control Precision; 
Response Orientation; 
Rate Control; 

Multilimb 

Coordination; 

ERAGO) 



PHYSICAL: 

Explosive Strength; 
Trunk Strength; 

Stamina; Extent 
Elexibility; Gross Body 
Coordination; Gross 

Body Equilibrium 





Post-conditions: Trainee understands higher commanders mission and intent; Trainee understands the threat and higher commanders CCIR; Trainee develops 
a plan for his unit that has taken account of specified, implied and critical tasks necessary to fulfill the higher headquarters mission; Trainee issues his mission 
order to his unit elements and controls it’s execution; Trainee exercises command 
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Score: Fair 1.75 


Action Item: Assess Civil Considerations 
Doctrine: FM 3-24, 3-34, 5-0 
Preconditions: 

1. Trainee is familiar with doctrinal description of assessment (FM 5-0) 

• Gather tools and assessment data. 

• Understand current and desired conditions. 

• Develop assessment measures and potential indicators. 

• Develop the collection plan. 

• Assign responsibilities for conducting analysis and generating 
recommendations. 

• Identify feedback mechanisms. 

2. Trainee has knowledge and understanding about civil considerations: The 
influence of manmade infrastructure, civilian institutions, and attitudes 
and activities of the civilian leaders, populations, and organizations within 
an AO on the conduct of military operations (FM 6-0). 

3. Trainee receives current information regarding important civil 
considerations in his area of operations. 

Tasks: 

1. Trainee develops or adopts an existing assessment mechanism to 
categorize civil considerations (e.g., SWEAT [sewage, water, electricity, 
academics, trash] or ASCOPE [areas, structures, capabilities, 
organizations, people, events]) 

2. Trainee gathers and processes all available information about the civil 
considerations in his AO. 

3. Trainee assigns a quantitative or qualitative value to each piece of the 
assessment mechanism based on 1. 

4. Trainee monitors status of the conditions on the ground and updates his 
assessment (repeat steps 1-3) as necessary. 

Post-conditions: Trainee is familiar with the important civil considerations within his 
AO; Trainee has increased proficiency in assessing the impact of civil considerations on 
military operations. 
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DEFINITION OF SCALE 


4-Very Good —the ITE contains a significant portion (75-100%) of the affordances 
determined during the initial analysis 

3-Good —the ITE contains a good portion (50-74%) of the affordances determined 
during the initial analysis 

2-Fair —the ITE contains some (25-49%) of the affordances determined during the 
initial analysis 

I-Poor —the ITE contains very few (0-24%) of the affordances determined during the 
initial analysis 
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Real World (RW) Preconditions: Trainee is familiar with doctrinal 
description of assessment (FM 5-0); Trainee has knowledge and 
understanding about civil considerations; Trainee receives current 
information regarding important civil considerations in his AO. 

Environment Evaluation 

No information concerning civil considerations within the AO is provided to 
the Trainee by the game or the scenarios violating this necessary 
precondition. 

RW Tasks 

RW Human Abilities 

RW Affordance 
Requirements 

Environment HA 

Environmental 

Affordances 

Level of Support to 
Training 

Trainee develops or 
adopts an existing 
assessment mechanism 
to categorize civil 
considerations. 

COGNITIVE: 

Written Expression; 

Oral Expression; 

Eluency of Ideas; Speed 
of Closure; Inductive 
Reasoning; Deductive 
Reasoning; Problem 
Sensitivity; Originality; 
Category Elexibility; 
Memorization 

SENSORY: 

Near vision; 

PSYCHOMOTOR: 

Manual Dexterity; 

Einger Dexterity 

PHYSICAL: 

None 

- Example assessment 
mechanism 

- Tools to develop an 
assessment 
mechanism (e.g., 
mission command 
systems, pens, paper, 
etc.) 

- Way to visualize 
assessment 

COGNITIVE: 

Eluency of Ideas; Speed 
of Closure; Inductive 
Reasoning; Deductive 
Reasoning; Problem 
Sensitivity; Originality; 
Category Elexibility; 
Memorization 

SENSORY: 

Near Vision 

PSYCHOMOTOR: 

Manual Dexterity; 

Einger Dexterity 

PHYSICAL: 

None 

- None 

4 - Very Good 

3 - Good 

2 - Pair 
*1 - Poor 

Trainee gathers and 
processes all available 
information about the 
civil considerations in 
his AO. 

COGNITIVE: Oral 
comprehension; Written 
comprehension; 

Inductive Reasoning; 
Problem Sensitivity; 
Information Ordering; 
Speed of Closure 

SENSORY: Near 

Vision 

- Information about the 
civilian population, 
government and urban 
landscape. 

- Known friction points 
between civilian 
population and 
friendly forces 

- Known problems 
within the civilian 

COGNITIVE: 

Written 

Comprehension; 
Inductive reasoning; 
Problem Sensitivity 

SENSORY: 

Near Vision 

PSYCHOMOTOR: 

Manual Dexterity; 

- Scenario editor 
provides the ability to 
have as much or as 
little information 
about the population 
as desired. This 
information would 
come from the BN 
OPORD. 

- System does not 
provide any way to 

*4 - Very Good 

3 - Good 

2 - Pair 

1 - Poor 
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PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity 

PHYSICAL: 

None 

population (e.g., 
fighting over oil 
rights) 

- Tools to annotate, 
arrange or depict 
information for 
analysis (e.g., mission 
command systems, 
acetate, map, alcohol 
pens, written order, 
paper, pencil, 
computer screens) 

Finger Dexterity 

PHYSICAL: 

None 

develop or annotate an 
assessment 

mechanism 


Trainee assigns a 
quantitative or 
qualitative value to 
each piece of the 
assessment mechanism 
based on 1. 

COGNITIVE: 

Mathematical 

Reasoning; Number 
Facility; Inductive 
Reasoning; Deductive 
Reasoning 

SENSORY: 

Near Vision; 

PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity 

PHYSICAL: 

None 

- Tools to mark or 
annotate the 

assessment 

mechanism 

- Assessment 
mechanism 

- Way to visualize the 
assessment 
mechanism (e.g., 
mission command 
system) 

COGNITIVE: 

None 

SENSORY: 

Near Vision 

PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity 

PHYSICAL: 

None 

- None 

4 - Very Good 

3 - Good 

2 - Fair 
*1 - Poor 

Trainee monitors status 
of the conditions on the 
ground and updates his 
assessment (repeat 
steps 1-3) as necessary. 

COGNITIVE: 

Oral Comprehension; 
Written 

Comprehension; 
Deductive Reasoning; 
Inductive Reasoning; 
Problem Sensitivity; 
Speed of Closure; 
Memorization; 

- Information about 
civil conditions in the 
area of operations that 
stimulate the use of an 

assessment 
mechanism or impact 
ongoing operations 
that the trainee must 

react to. 

COGNITIVE: 

Oral Comprehension; 
Written 

Comprehension; 
Deductive Reasoning; 
Inductive Reasoning; 
Problem Sensitivity; 
Speed of Closure; 
Memorization 

- None 

4 - Very Good 

3 - Good 

2 - Fair 
*1 - Poor 
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SENSORY: 

- Mission command 

SENSORY: 


Peripheral Vision; 

system if used and 

Near Vision 


Depth Perception; Far 

available 



Vision; Near Vision; 


PSYCHOMOTOR: 


Speech Recognition; 


None 


PSYCHOMOTOR: 


PHYSICAL: 


None 


None 


PHYSICAL: 




None 





Post-conditions: Trainee is familiar with the important civil considerations within his AO; Trainee has increased proficiency in assessing the impact of civil 
considerations on military operations. 
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Score: Good 3.28 


Action Item: Integrate fundamentals and techniques of the offense into a COA 
Doctrine: FM 3-21.10, 5-0 

Preconditions: Trainee has understands the fundamentals of offensive operations 
(Surprise, Concentration, Audacity, Tempo, Flexibility); Trainee has been issued a 
mission order that directs his element to conduct an offensive operation; Trainee is 
familiar with the techniques of offensive operations (Movement to Contact, Attack, 
Exploitation, Pursuit) 


Task: Develop an offensive COA 

1. Identify the necessary offensive technique for the specified mission (Movement to 
Contact, Attack, Exploitation, Pursuit) 

2. Analyze relative combat power (strengths and weaknesses) 

3. Generate options that incorporate the fundamentals of offensive operations and 
offensive technique 

4. Array the forces available 

5. Develop an offensive concept of the operation 

6. Assign responsibilities 

7. Prepare a COA statement and sketch 

Post-conditions: COA is developed that incorporates the fundamentals of the offense 
appropriately and meets the criteria of being suitable, acceptable, feasible, distinguishable 
and complete. 

DEFINITION OF SCALE 

4-Very Good —the ITE contains a significant portion (75-100%) of the affordances 
determined during the initial analysis 

3-Good —the ITE contains a good portion (50-74%) of the affordances determined 
during the initial analysis 

2-Fair —the ITE contains some (25-49%) of the affordances determined during the 
initial analysis 

I-Poor —the ITE contains very few (0-24%) of the affordances determined during the 
initial analysis 
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Real World (RW) Preconditions: Trainee has understands the 
fundamentals of offensive operations (Surprise, Concentration, Audacity, 
Tempo, Flexibility); Trainee is familiar with the techniques of offensive 
operations (Movement to Contact, Attack, Exploitation, Pursuit); Trainee has 
been issued a mission order that directs his element to conduct an offensive 
operation. 

Environment Evaluation 

RW Tasks 

RW Human Abilities 

RW Affordance 
Requirements 

Environment HA 

Environmental 

Affordances 

Limit of Support to 
Training 

Identify the necessary 
offensive technique for 
the specified mission 

COGNITIVE: 

Oral Comprehension; 
Written 

Comprehension; 
Deductive Reasoning; 
Inductive Reasoning; 
Speed of Closure; 
Memorization; 

SENSORY: 

Near Vision; Speech 
Recognition 

PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity 

PHYSICAL: 

None 

- Operations order from 
the higher 
headquarters that 
informs the trainee 
about the higher 
headquarters mission 
and what tasks his 
unit is responsible for. 

- See analyze enemy 
situation 

- See perform terrain 
analysis 

- See conduct mission 
analysis 

COGNITIVE: 

Written 

Comprehension; 
Deductive Reasoning; 
Inductive Reasoning; 
Speed of Closure 

SENSORY: 

Near Vision 

PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity 

PHYSICAL: 

None 

- Higher HQ OPORD 

- See assess enemy 
situation 

- See perform terrain 
analysis 

- See conduct mission 
analysis 

4 - Very Good 
*3 - Good 

2 - Fair 

1 - Poor 

Analyze own relative 
combat power 
(strengths, weaknesses) 

COGNITIVE: 

Written 

Comprehension; 
Deductive Reasoning; 
Inductive Reasoning; 
Problem Sensitivity; 
Mathematical 

Reasoning; 

Visualization; Speed of 
Closure; 

- See determine own 
force potential combat 
power 

COGNITIVE: 

Written 

Comprehension; 
Deductive Reasoning; 
Inductive Reasoning; 
Problem Sensitivity; 
Mathematical 

Reasoning; 

Visualization; Speed of 
Closure; 

- See determine own 
force potential combat 
power 

*4 - Very Good 

3 - Good 

2 - Fair 

1 - Poor 
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SENSORY: Near 


SENSORY: Near 




Vision; 


Vision; 




PSYCHOMOTOR: 


PSYCHOMOTOR: 




Manual Dexterity; 


Manual Dexterity; 




Finger Dexterity; 


Finger Dexterity; 




PHYSICAL: 


PHYSICAL: 




None 


None 



Generate options that 

COGNITIVE: 

- Higher commanders 

COGNITIVE: 

- Scenario editor 

4 - Very Good 

incorporate the 

Deductive Reasoning; 

intent and desired 

Deductive Reasoning; 

- See perform terrain 

*3 - Good 

fundamentals of 

Inductive Reasoning; 

endstate 

Inductive Reasoning; 

analysis 

2 - Fair 

offensive operations 

Fluency of Ideas; 

- See perform terrain 

Fluency of Ideas; 

- See assess enemy 

1 - Poor 

and offensive technique 

Originality; Problem 

analysis 

Originality; Problem 

situation 



Sensitivity; Information 

- See assess enemy 

Sensitivity; Information 

- See conduct 



Ordering; Mathematical 

situation 

Ordering; Mathematical 

reconnaissance 



Reasoning; 

- See conduct 

Reasoning; 

- See conduct mission 



Visualization; Speed of 

reconnaissance 

Visualization; Speed of 

analysis 



Closure; Memorization; 

- See conduct mission 
analysis 

Closure; Memorization; 




SENSORY: 

SENSORY: 




Near Vision 


Near Vision 




PSYCHOMOTOR: 


PSYCHOMOTOR: 




Manual Dexterity; 


Manual Dexterity; 




Finger Dexterity; 


Finger Dexterity; 




PHYSICAL: 


PHYSICAL: 




None 


None 



Array the forces 

COGNITIVE: 

- See determine own 

COGNITIVE: 

- See determine own 

4 - Very Good 

available 

Deductive Reasoning; 

force potential combat 

Deductive Reasoning; 

force potential combat 

*3 - Good 


Information Ordering; 

power 

Information Ordering; 

power 

2 - Fair 


Visualization; Spatial 

- See develop a light 

Visualization; Spatial 

- See develop a light 

1 - Poor 


Orientation; 

infantry course of 

Orientation; 

infantry course of 



Memorization; 

action 

Memorization; 

action 




- See conduct mission 


- See conduct mission 
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SENSORY: 

analysis 

SENSORY: 

analysis 



Near Vision; 


Near Vision; 




PSYCHOMOTOR: 


PSYCHOMOTOR: 




Manual Dexterity; 


Manual Dexterity; 




Finger Dexterity; 


Finger Dexterity; 




PHYSICAL: None 


PHYSICAL: None 



Develop an offensive 

COGNITIVE: 

- See develop a light 

COGNITIVE: 

- See develop a light 

4 - Very Good 

concept of operations 

Deductive Reasoning; 

infantry course of 

Deductive Reasoning; 

infantry course of 

*3 - Good 


Inductive Reasoning; 

action 

Inductive Reasoning; 

action 

2 - Fair 


Information Ordering; 

- See conduct 

Information Ordering; 

- See conduct 

1 - Poor 


Visualization; Problem 

reconnaissance 

Visualization; Problem 

reconnaissance 



Sensitivity; 

- See conduct mission 

Sensitivity; 

- See conduct mission 



Memorization 

analysis 

Memorization 

analysis 




- See assess civil 


- See assess civil 



SENSORY: 

considerations 

SENSORY: 

considerations 



Near Vision; Visual 


Near Vision; Visual 




Color Discrimination 


Color Discrimination 




PSYCHOMOTOR: 


PSYCHOMOTOR: 




Manual Dexterity; 


Manual Dexterity; 




Finger Dexterity 


Finger Dexterity 




PHYSICAL: 


PHYSICAL: 




None 


None 



Assign responsibilities 

COGNITIVE: 

- A way to verbally, 

COGNITIVE: 

- Order process where 

*4 - Very Good 


Deductive Reasoning; 

orally or pictorially 

Deductive Reasoning; 

tasks are assigned to 

3 - Good 


Problem Sensitivity; 

represent the 

Problem Sensitivity; 

units 

2 - Fair 


Speed of Closure; 

responsibilities for 

Speed of Closure; 


1 - Poor 


Perceptual Speed; 

tasks/missions to 

Perceptual Speed; 




Memorization 

subordinate 

Memorization 





units/elements 





SENSORY: 


SENSORY: 




Near Vision; Speech 


Near Vision; Speech 




Clarity 


Clarity 
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PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity; 


PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity; 




PHYSICAL: None 


PHYSICAL: None 



Prepare a COA 
statement and sketch 

COGNITIVE: Written 
Expression; 

Information Ordering 

SENSORY: 

Near Vision; Visual 
Color Discrimination 

- See develop a light 
infantry COA 

COGNITIVE: Written 
Expression; 

Information Ordering 

SENSORY: 

Near Vision; Visual 
Color Discrimination 

- See develop a light 
infantry COA 

4 - Very Good 
*3 - Good 

2 - Fair 

1 - Poor 


PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity; 


PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity; 




PHYSICAL: 

None 


PHYSICAL: 

None 



Post-conditions: COA is developed that incorporates the fundamentals of the offense appropriately and meets the criteria of being suitable, acceptable, 
feasible, distinguishable and complete. 
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Score: Good 3.00 


Action Item: Conduct Mission Analysis 
Doctrine: FM 3-21.10, 5-0 

Preconditions: Trainee has received the mission; Trainee has issued a warning order 
(WARNO) 

Tasks: 

1. Analyze Mission 

a. Purpose 

b. Tasks 

c. Constraints 

d. Develop a Restated Mission 

2. Conduct Terrain Analysis (Separate Evaluation) 

3. Analyze Enemy Situation (Separate Evaluation) 

4. Develop Commander Critical Information Requirements (CCIR) 

5. Conduct Troop Analysis (Separate Evaluation) 

6. Conduct analysis of available time 

7. Analyze Civil Considerations (Separate Evaluation) 

8. Conduct a risk assessment 

9. Identify tentative decisive points based on conclusions and intuition 

10. Develop a commander’s intent 

11. Issue a warning order 

Post-conditions: Trainee unit’s mission is known; Trainee comprehends the current 
situation ; Trainee has a conceptual understanding of how his unit will accomplish the 
mission; Trainee has identified potential risks of the operation. 


DEFINITION OF SCALE 

4-Very Good —the ITE contains a significant portion (75-100%) of the affordances 
determined during the initial analysis 

3-Good —the ITE contains a good portion (50-74%) of the affordances determined 
during the initial analysis 

2-Fair —the ITE contains some (25-49%) of the affordances determined during the 
initial analysis 

I-Poor —the ITE contains very few (0-24%) of the affordances determined during the 
initial analysis 
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Real World (RW) Preconditions: Trainee has received the mission; Trainee 
has Issued a warning order (WARNO) 

Environment Evaluation 


RW Tasks 

RW Human Abilities 

RW Affordance 
Requirements 

Environment HA 

Environmental 

Affordances 

Level of Support to 
Training 

Analyze the Mission 

COGNITIVE: 

Oral Comprehension; 
Written 

Comprehension; 
Deductive Reasoning; 
Inductive Reasoning; 
Problem Sensitivity; 
Information Ordering; 
Visualization; Speed of 
Closure; Perceptual 
Speed; Memorization; 
Time Sharing; 

SENSORY: 

Near Vision; Speech 
Recognition 

PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity; 

PHYSICAL: 

None 

- Trainee must have 
been given a mission 
with implied, 
specified and critical 
tasks. The mission 
should have a timeline 
for completion. 

- The information 
provided to the trainee 
should answer the 
questions of who, 
what, where, when 
and why or the trainee 
should be able to 
process the given 
information to draw 
inferences that answer 
the questions 

- Trainee must be able 
to review the higher 
commanders order 
and parse information 
that he deems 
necessary. The 
environment should 
support the trainee in 
parsing information, 
drafting plans and 
identifying tasks his 
unit must accomplish 

- Environment should 
support the 

COGNITIVE: 

Written 

Comprehension; 
Inductive Reasoning; 
Deductive Reasoning; 
Problem Sensitivity; 
Visualization; Speed of 
Closure; 

SENSORY: 

Near Vision 

PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity; 

PHYSICAL: 

None 

- Scenario editor and 
higher HQ order 

- Trainee not able to 
draft a mission 

statement 

*4 - Very Good 

3 - Good 

2 - Fair 

1 - Poor 
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development and 
drafting of a mission 
statement 




Conduct Terrain 

Analysis 

See perform terrain 
analysis 

See perform terrain 
analysis 

See perform terrain 
analysis 

See perform terrain 
analysis 

*4 - Very Good 

3 - Good 

2 - Pair 

1 - Poor 

Analyze Enemy 

Situation 

See analyze enemy 
situation 

See analyze enemy 
situation 

See analyze enemy 
situation 

See analyze enemy 
situation 

4 - Very Good 
*3 - Good 

2 - Pair 

1 - Poor 

Develop Commander 
Critical Information 
Requirements (CCIR) 

COGNITIVE: 

Oral Expression; Oral 
Comprehension; 

Written 

Comprehension; 

Written Expression; 
Deductive Reasoning; 
Inductive Reasoning; 
Problem Sensitivity; 
Mathematical 

Reasoning; Speed of 
Closure; Perceptual 
Speed; Memorization; 
Time Sharing; 

SENSORY: 

Near Vision; Speech 
Clarity; Speech 
Recognition; 

PSYCHOMOTOR: 

Manual Dexterity; 

Einger Dexterity; 

PHYSICAL: 

None 

- Trainee must be 
provided with 
materials (i.e., 
intelligence materials) 
that provide or 
support the inference 
of CCIR. 

- Tools to author, refine 
and transmit CCIR’s 
to trainee’s unit via 
voice or digital 
means. 

- A way to denote and 
link CCIR to the 
operational plan. 

COGNITIVE: 

Written 

Comprehension; 
Deductive Reasoning; 
Inductive Reasoning; 
Problem Sensitivity 

SENSORY: 

Near Vision; 

PSYCHOMOTOR: 

Manual Dexterity; 

Einger Dexterity; 

PHYSICAL: 

None 

- Scenario may provide 
higher headquarters 
CCIR if included in 
the OPORD. 

- No ability for the 
trainee to develop or 
denote CCIR for his 
unit or transmit CCIR 
as part of the 
COA/OPORD for 
execution. 

4 - Very Good 

3 - Good 
*2 - Pair 

1 - Poor 
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Conduct Troop 

Analysis 

See determine own 
force potential combat 
power 

See determine own 
force potential combat 
power 

See determine own 
force potential combat 
power 

See determine own 
force potential combat 
power 

*4 - Very Good 

3 - Good 

2 - Fair 

1 - Poor 

Conduct analysis of 
available time 

COGNITIVE: 

Written 

Comprehension; Oral 
Comprehension; 
Deductive Reasoning; 
Inductive Reasoning; 
Problem Sensitivity; 
Number Facility; Speed 
of Closure; Selective 
Attention; Time 

Sharing; 

SENSORY: 

Near Vision; Speech 
Recognition 

PSYCHOMOTOR: 

None 

PHYSICAL: 

None 

- Time context i.e., the 
present time or a 
scripted future or past 
time. 

- Trainee must have a 
starting time from 
which to plan from 
and against. 

- Orders must specify a 
time or time frame for 
mission 

accomplishment so 
that the trainee may 
execute this analysis. 

- A way to develop and 
transmit a timeline for 
mission 

accomplishment 

COGNITIVE: 

Written 

Comprehension; 
Deductive Reasoning; 
Inductive Reasoning; 
Problem Sensitivity; 
Number Facility; Time 
Sharing 

SENSORY: 

Near Vision; 

PSYCHOMOTOR: 

None 

PHYSICAL: 

None 

- Game allows for play 
to go from 30 min to 
4:30 in 30 min 
increments 

- Time my begin during 
planning phase if 
selected 

- Scenario may provide 
information relating to 
when mission must 
start and be completed 
by. 

- Time is annotated on 
the CDR POV screen 
during execution of 
mission 

- Trainee unable to 
develop, display or 
transmit a timeline 

*4 - Very Good 

3 - Good 

2 - Fair 

1 - Poor 

Analyze Civil 
Considerations 

See assess civil 
considerations 

See assess civil 
considerations 

See assess civil 
considerations 

See assess civil 
considerations 

4 - Very Good 

3 - Good 
*2 - Fair 

1 - Poor 

Conduct a risk 

assessment 

COGNITIVE: 

Oral Comprehension; 
Written 

Comprehension; 
Deductive Reasoning; 
Inductive Reasoning; 
Problem Sensitivity; 
Visualization; Spatial 

- See analyze enemy 
situation 

- See perform terrain 
analysis 

- See determine own 
force potential combat 
power 

- Environment must 

COGNITIVE: 

Written 

Comprehension; 
Deductive Reasoning; 
Inductive Reasoning; 
Problem Sensitivity; 
Visualization; Speed of 
Closure; Perceptual 

- No risk management 
plan, template or 
functionality is 
explicitly included in 
the game. All risk 
management 
functionality is 
implicitly included in 

4 - Very Good 
*3 - Good 

2 - Fair 

1 - Poor 
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Orientation; Speed of 
Closure; Perceptual 
Speed; Memorization; 
Time Sharing; 

SENSORY: 

Near Vision; Speech 
Recognition 

PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity; 

PHYSICAL: None 

support the 
development of a risk 
management plan for 
the unit that identifies 
risks and controls 

Speed; Memorization; 
Time Sharing; 

SENSORY: 

Near Vision; 

PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity; 

PHYSICAL: 

None 

other activities. 


Identify tentative 
decisive points based 
on conclusions and 
intuition 

COGNITIVE: 

Oral Comprehension; 
Written 

Comprehension; 
Deductive Reasoning; 
Inductive Reasoning; 
Problem Sensitivity; 
Visualization; Speed of 
Closure; Memorization; 
Time Sharing; 

SENSORY: 

Near Vision; Speech 
Recognition; 

PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity; 

PHYSICAL: 

None 

- Scenario that contains 
information that 
supports the trainee in 
the identification and 
development of 
decisive points that 
define how, where, or 
when the unit will 
accomplish its 
purpose. 

- Information from 
intelligences sources 
about the enemy and 
the higher 
commanders intent 
and vision 

- A way to denote or 
annotate decisive 
points in the order or 
on the COA sketch. 

COGNITIVE: 

Written 

Comprehension; 
Deductive Reasoning; 
Inductive Reasoning; 
Problem Sensitivity; 
Visualization; Speed of 
Closure; Memorization; 

SENSORY: 

Near Vision; 

PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity; 

PHYSICAL: 

None 

- Scenario editor 
provides ability to 
include pertinent 
information to 

OPORD 

- Intelligence materials 
may be developed and 
added to background 
and OPORD 

4 - Very Good 
*3 - Good 

2 - Pair 

1 - Poor 

Develop a commanders 
intent 

COGNITIVE: 

Written Expression; 

- Outputs from 
previously identified 

COGNITIVE: 

Written Expression; 

- See analyze enemy 
situation 

4 - Very Good 
*3 - Good 
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Deductive Reasoning; 
Problem Sensitivity; 
Information Ordering; 
Mathematical 

Reasoning; 

Visualization; Speed of 
Closure; Memorization; 

SENSORY: 

Near Vision; Speech 
Recognition; 

PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity; 

PHYSICAL: 

None 

steps 

- See analyze enemy 
situation 

- See perform terrain 
analysis 

- See determine own 
force potential combat 
power 

- See conduct 
reconnaissance 

- See develop a light 
infantry company 
course of action 

Deductive Reasoning; 
Problem Sensitivity; 
Information Ordering; 
Mathematical 

Reasoning; 

Visualization; Speed of 
Closure; Memorization; 

SENSORY: 

Near Vision; 

PSYCHOMOTOR: 

Manual Dexterity; 

Einger Dexterity; 

PHYSICAL: 

None 

- See perform terrain 
analysis 

- See determine own 
force potential combat 
power 

- See conduct 
reconnaissance 

- See develop a light 
infantry company 
course of action 

- CO A/Order 
development process 
does not include the 
ability to express the 

CL 

2 - Eair 

1 - Poor 

**Math: this step 
includes evaluation of 
each step for this 
subtask as well as all of 
the steps from all of the 
previous subtasks. If 
subtask was roll up of 
others then just the 
score from the umbrella 
subtask was used to 
eliminate double and 
triple counting. This 
score 3.25 

Issue a warning order 

COGNITIVE: 

Written 

Comprehension, Oral 
Expression, Written 
Expression; 

SENSORY: 

Near Vision; Speech 
Clarity 

PSYCHOMOTOR: 

Arm Hand Steadiness; 
Manual Dexterity; 

Einger Dexterity; 

PHYSICAL: 

Extent Elexibility 

- Correct order format 

- Means to deliver the 
WO 

- Information from 
previous steps 

COGNITIVE: 

None 

SENSORY: 

None 

PSYCHOMOTOR: 

None 

PHYSICAL: 

None 

- No warning order 
functionality exists 
within ESC 

4 - Very Good 
*3 - Good 

2 - Pair 

1 - Poor 

**Step would have 
been rated as poor if 
affordances not treated 
equally. 

Post-conditions: Trainee unit’s mission is known; Trainee comprehends the current situation; Trainee has a conceptual understanding of how his unit will 
accomplish the mission; Trainee has identified potential risks of the operation 
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Score: Good 3.30 


Action Item: Plan Breaching Operations 
Doctrine: FM 3-21.10, 5-0 

Preconditions: Mission order received directing unit to conduct breaching operations as 
part of or as their mission; Task organization for mission is provided; Breaching assets 
are allocated and provided to trainee. 

Task: Trainee applies the five tenants of planning for breach operations: intelligence, 
fundamentals, organization, mass and synchronization. 

1. Trainee evaluates the enemy situation and applies this information to his plan 

2. Trainee considers the terrain and how it supports breach execution (approach 
routes; primary/alternate breach point; SBF position; fire support positioning) 

3. Trainee organizes his assets (i.e., support, breach and assault forces and security 
element) 

4. Trainee applies the fundamentals of breaching (SOSRA) suppress, obscure, 
secure, reduce, and assault in planning 

5. Trainee synchronizes the positioning and effects of all aspects of breaching 
through the use of control measures 

6. Trainee authors the plan. 

Post-conditions: Synchronized breaching plan developed. 


DEFINITION OF SCALE 

4-Very Good —the ITE contains a significant portion (75-100%) of the affordances 
determined during the initial analysis 

3-Good —the ITE contains a good portion (50-74%) of the affordances determined 
during the initial analysis 

2-Fair —the ITE contains some (25-49%) of the affordances determined during the 
initial analysis 

I-Poor —the ITE contains very few (0-24%) of the affordances determined during the 
initial analysis 
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Real World (RW) Preconditions: Mission order received directing unit 
conduct breaching operations as part of or as their mission; Task organization 
provided; Breaching assets allocated 

Environment Evaluation 

RW Tasks 

RW Human Abilities 

RW Affordance 
Requirements 

Environment HA 

Environmental 

Affordances 

Limit of Support to 
Training 

Trainee evaluates the 
enemy situation and 
applies this information 
to his plan. 

- See analyze enemy 
situation 

- See analyze enemy 
situation 

- See analyze enemy 
situation 

- See analyze enemy 
situation 

4 - Very Good 
*3 - Good 

2 - Fair 

1 - Poor 

Trainee considers the 
terrain and how it 
supports breach 
execution (approach 
routes; 

primary/alternate 
breach point; SBF 
position; Fire support 
positioning) 

- See perform terrain 
analysis 

- See perform terrain 
analysis 

- See perform terrain 
analysis 

- See perform terrain 
analysis 

*4 - Very Good 

3 - Good 

2 - Fair 

1 - Poor 

Trainee organizes his 
assets recognizing 
strengths and 
weaknesses (i.e.. 

Support, Breach and 
Assault Forces & 

Security element) 

- See determine own 
force potential combat 
power 

- See determine own 
force potential combat 
power 

- See determine own 
force potential combat 
power 

- See determine own 
force potential combat 
power 

*4 - Very Good 

3 - Good 

2 - Fair 

1 - Poor 

Trainee applies the 
fundamentals of 
breaching (SOSRA) 
suppress, obscure, 
secure, reduce, and 
assault in planning 

COGNITIVE: 

Deductive Reasoning; 
Inductive Reasoning; 
Problem Sensitivity; 
Information Ordering; 
Visualization; Spatial 
Orientation; 
Memorization 

SENSORY: 

Near Vision; Visual 

- Tools that allow the 
trainee to develop and 
manipulate a 
breaching plan (e.g., 
alcohol pens, mission 
command systems) 

- See develop a light 
infantry company 

COA 

COGNITIVE: 

Deductive Reasoning; 
Problem Sensitivity; 
Information Ordering; 
Visualization; 

SENSORY: 

Near Vision; Visual 
Color Discrimination 

PSYCHOMOTOR: 

- Game order planning 
screen allows trainee 
to build plan and 
adjust as desired 

4 - Very Good 
*3 - Good 

2 - Fair 

1 - Poor 
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Color Discrimination 

PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity 

PHYSICAL: 

None 


Manual Dexterity; 

Linger Dexterity 

PHYSICAL: 

None 



Trainee synchronizes 
the positioning and 
effects of all aspects of 
breaching through the 
use of control measures 

COGNITIVE: 

Deductive Reasoning; 
Problem Sensitivity; 
Information Ordering; 
Visualization; 
Memorization 

SENSORY: 

Near Vision; 

PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity; 

PHYSICAL: None 

- A method and tools 
(e.g., mission 
command system) for 
developing a plan 

- Doctrinal graphical 
symbology (e.g., 
control measures) 

- See develop a light 
infantry company 

COA 

- A method to conduct 
time and battlespace 
synchronization 
during planning 

COGNITIVE: 

Deductive Reasoning; 
Problem Sensitivity; 
Information Ordering; 
Visualization; 

SENSORY: 

Near Vision; 

PSYCHOMOTOR: 

Manual Dexterity; 

Linger Dexterity; 

PHYSICAL: None 

- OPORD planning 
screen allows trainee 
to build a plan using 
phases and other 
limited doctrinal 
control measures 

- Phase lines, breach 
symbol 

- See develop a light 
infantry COA 

4 - Very Good 
*3 - Good 

2 - Pair 

1 - Poor 

Trainee authors the 
plan 

COGNITIVE: 

Oral Expression; 

Written Expression; 

SENSORY: 

Near Vision, Visual 
Color Discrimination 

PSYCHOMOTOR: 

Manual Dexterity; 

Einger Dexterity; 

PHYSICAL: None 

- Tools to draft/build 
the plan (e.g., maps, 
acetate, alcohol pens, 
mission command 
system) 

- A way to depict the 
plan so others may see 
and understand it 
(e.g., butcher boards, 
mission command 
systems) 

COGNITIVE: Written 
Expression; 

SENSORY: 

Near Vision, Visual 
Color Discrimination 

PSYCHOMOTOR: 

Manual Dexterity; 

Linger Dexterity; 

PHYSICAL: 

None 

- Game provides 
functionality to 
develop an order that 
includes breaching 
information 

4 - Very Good 
*3 - Good 

2 - Pair 

1 - Poor 

Post-conditions: Synchronized plan for breaching an obstacle exists 
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Score: Very Good 3.66 

Action Item: Apply the fundamentals of conducting a movement to contact (MTC) 


Doctrine: FM 3-21.10, 3-90 

Preconditions: Mission order received directing unit to conduct offensive operations to 
gain intelligence or contact with an enemy force; Trainee is knowledgeable of doctrine 
about how to conduct a MTC and the fundamentals of conducting a MTC; Trainee is 
proficient in the development of MTC COA 

Tasks: 

1. Develop a plan/COA that includes the following fundamentals: 

a. Focus all reconnaissance efforts on finding the enemy 

b. Make contact with the enemy using the smallest element possible (visual 
contact preferred) 

c. Avoid decisive engagement with the main body until conditions are favorable 

d. Maintain freedom of maneuver and mutual support between and within unit 
elements 

e. Maintain contact with the enemy 

2. Command and control the execution of the plan 


Post-conditions: Contact made with the enemy on favorable terms; Unit achieves 
tactical/operational objectives 


DEFINITION OF SCALE 

4-Very Good —the ITE contains a significant portion (75-100%) of the affordances 
determined during the initial analysis 

3-Good —the ITE contains a good portion (50-74%) of the affordances determined 
during the initial analysis 

2-Fair —the ITE contains some (25-49%) of the affordances determined during the 
initial analysis 

I-Poor —the ITE contains very few (0-24%) of the affordances determined during the 
initial analysis 
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Real World (RW) Preconditions: Mission order received directing unit to 
conduct offensive operations to gain intelligence or contact with an enemy 
force; Trainee is knowledgeable of doctrine about how to conduct a MTC and 
the fundamentals of conducting a MTC; Trainee is proficient in the 
development of MTC COA 

Environment Evaluation 

RW Tasks 

RW Human Abilities 

RW Affordance 
Requirements 

Environment HA 

Environmental 

Affordances 

Level of Support to 
Training 

Develop a course of 

action that includes: 

- Focus all 
reconnaissance efforts 
on finding the enemy 

- Make contact with the 
enemy using the 
smallest element 
possible (visual 
contact preferred) 

- Avoid decisive 
engagement with the 
main body until 
conditions are 
favorable 

- Maintain freedom of 
maneuver and mutual 
support between and 
within unit elements 

- Maintain contact with 
the enemy 

COGNITIVE: 

Oral Comprehension; 
Written 

Comprehension; 
Deductive Reasoning; 
Fluency of Ideas; 
Information Ordering; 
Mathematical 

Reasoning; Speed of 
Closure; Memorization; 
Selective Attention 

SENSORY: 

Near Vision; 

PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity; 

PHYSICAL: 

None 

- Higher Commanders 
intent and desired 
operational endstate 

- See determine own 
force potential combat 
power 

- See perform terrain 
analysis 

- See assess enemy 
situation 

- See develop a light 
infantry course of 
action 

- Intelligent Soldiers 
that are knowledgeable 
of MTC fundamentals 
and doctrine 

COGNITIVE: 

Written 

Comprehension; 
Deductive Reasoning; 
Fluency of Ideas; 
Information Ordering; 
Memorization; 

SENSORY: 

Near Vision; 

PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity; 

PHYSICAL: 

None 

- Scenario editor allows 
for the inclusion of 
commanders intent 
and desired endstate. 

- Planning tab includes 
an orders development 
capability that allows 
the trainee to build an 
Order. 

- Trainee does not have 
any control over the 
movement of the 
individual avatars 

*4 - Very Good 

3 - Good 

2 - Fair 

1 - Poor 

Command and Control 
the execution of the plan 

COGNITIVE: 

Oral Expression; Oral 
Comprehension; 

Written 

- Intelligent Soldiers 
that are knowledgeable 
of MTC fundamentals 

COGNITIVE: 

Oral Comprehension; 
Written 

Comprehension; 

- Scenario representing 
environment, higher 
commander and own 

*4 - Very Good 

3 - Good 

2 - Fair 

1 - Poor 
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Comprehension; 
Deductive Reasoning; 
Fluency of Ideas; 
Inductive Reasoning; 
Originality; Problem 
Sensitivity; Information 
Ordering; Mathematical 
Reasoning; 
Visualization; Spatial 
Orientation; Speed of 
Closure; Perceptual 
Speed; Memorization; 
Selective Attention; 
Time Sharing; 

SENSORY: 

Night Vision; Peripheral 
Vision; Glare 
Sensitivity; Depth 
Perception; Far Vision; 
Near Vision; Visual 
Color Discrimination; 
Auditory Attention; 
Speech Clarity; Speech 
Recognition; Hearing 
Sensitivity; Sound 
Localization; 

PSYCHOMOTOR: 

Arm-Hand Steadiness; 
Manual Dexterity; 
Finger Dexterity; 
Control Precision; 
Response Orientation; 
Rate Control; Multilimb 
Coordination; 


and doctrine 

- Tactical scenario that 
provides a higher 
commander, enemy 
and physical 
environment. 

- Verbal or digital 
communication 
capability between the 
trainee, his unit 
elements and his 
higher headquarters. 

- Physical or visual 
interaction between 
the trainee, his 
subordinate elements, 
his higher 

headquarters and the 
enemy. 

- Environment should 
afford the trainee a 
way to adjust his plan 
and issue new orders 
during the scenario as 
in real life. 


Deductive Reasoning; 
Fluency of Ideas; 
Inductive Reasoning; 
Information Ordering; 
Spatial Orientation; 
Memorization; Time 
Sharing; 

SENSORY: Near 
Vision; Visual Color 
Discrimination; 

PSYCHOMOTOR: 

Manual Dexterity; 
Finger Dexterity; 

PHYSICAL: 

None 


unit elements and 
enemy 

- Limited scripted 
simulated radio 
communications 

- Limited simulated 
visual/physical contact 
with enemy, own 
troops and higher 
headquarters 

- FRAGO capability is 
present 


** This item would be 
rated as Fair due to the 
limited interaction 
between the game 
entities and the trainee if 
affordances were not all 
considered equal 
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PHYSICAL: 

Explosive Strength; 

Trunk Strength; 

Stamina; Extent 
Elexibility; Gross Body 
Coordination; Gross 

Body Equilibrium 





Issue a Fragmentary 

Order [FRAGO] (as 
needed) 

See issue a fragmentary 
order 

See issue a fragmentary 
order 

See issue a fragmentary 
order 

See issue a fragmentary 
order 

4 - Very Good 
*3 - Good 

2 - Eair 

1 - Poor 

Post-conditions: Contact made with the enemy on favorable terms; Unit achieves tactical/operational objectives 
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Score: Good 3.00 


Action Item: Integrate Fire Support Into Urban Operations 

Doctrine: FM 3-21.10 

Preconditions: Mission order provided to trainee; Fire support assets available to the 

trainee are specified; Trainee is knowledgeable on urban operations (UO) doctrine, the 

current ROE for use of indirect fire/mortars and the enemy situation. 

Tasks: 

1. Process information on the capabilities of own unit and general fire support assets 
available 

2. Process information concerning the enemy’s capabilities and possible use of 
urban terrain 

3. Process information concerning the ROE and any civil considerations affected by 
the use of indirect fire/mortars 

4. Develop a fire support plan for the mission 


Post-conditions: Eire Support plan is developed; Eire Support Coordination and Control 
measures are known by the unit; Eire support is integrated into the movement and 
maneuver plan. 


DEFINITION OF SCALE 

4-Very Good —the ITE contains a significant portion (75-100%) of the affordances 
determined during the initial analysis 

3-Good —the ITE contains a good portion (50-74%) of the affordances determined 
during the initial analysis 

2-Fair —the ITE contains some (25-49%) of the affordances determined during the 
initial analysis 

I-Poor —the ITE contains very few (0-24%) of the affordances determined during the 
initial analysis 
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Real World (RW) Preconditions: Mission order provided to trainee; Fire 
support assets available to the trainee are specified; Trainee is knowledgeable 
on Urban Operations (UO) doctrine, the current ROE for use of indirect 
fire/mortars and the enemy situation 

Environment Evaluation 

RW Tasks 

RW Human Abilities 

RW Affordance 
Requirements 

Environment HA 

Environmental 

Affordances 

Limit of Support to 
Training 

Process information on 
the capabilities of own 
unit and general fire 
support assets available 

COGNITIVE: 

Written 

Comprehension; Oral 
Comprehension; 
Deductive Reasoning; 
Inductive Reasoning; 
Problem Sensitivity; 
Speed of Closure 

SENSORY: 

Near Vision; Speech 
Recognition 

PSYCHOMOTOR: 

None 

PHYSICAL: 

None 

- See assessment of 
determine own force 
potential combat 
power. 

- Information about any 
additional fire support 
assets allocated for the 
unit’s use during an 
operation (e.g., size, 
number, etc.) 

COGNITIVE: 

Written 

Comprehension; 
Inductive Reasoning; 
Problem Sensitivity; 
Speed of Closure 

SENSORY: 

Near Vision; 

PSYCHOMOTOR: 

Manual Dexterity, 

Finger Dexterity 

PHYSICAL: 

None 

- Editable scenario that 
may provide detail as 
necessary 

- Default force structure 
that includes mortar 

assets 

*4 - Very Good 

3 - Good 

2 - Fair 

1 - Poor 

Process information 
concerning the enemy’s 
capabilities and 
possible use of urban 
terrain 

COGNITIVE: 

Written 

Comprehension; Oral 
Comprehension; 
Deductive Reasoning; 
Inductive Reasoning; 
Problem Sensitivity; 
Visualization; 
Memorization 

SENSORY: 

Near Vision; Speech 
Recognition 

- See analyze enemy 
situation 

- See perform terrain 
analysis 

COGNITIVE: 

Written 

Comprehension; 
Deductive Reasoning; 
Inductive Reasoning; 
Problem Sensitivity; 
Visualization; 

SENSORY: 

Near Vision 

PSYCHOMOTOR: 

None 

- See analyze enemy 
situation 

- See perform terrain 
analysis 

4 - Very Good 
*3 - Good 

2 - Fair 

1 - Poor 
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PSYCHOMOTOR: 

None 


PHYSICAL: 

None 




PHYSICAL: None 





Process information 
concerning the ROE 
and any civil 
considerations affected 
by the use of indirect 
fire/mortars 

COGNITIVE: 

Written 

Comprehension; Oral 
Comprehension; 
Deductive Reasoning; 
Inductive Reasoning; 
Problem Sensitivity; 
Visualization; 
Memorization 

SENSORY: 

Near Vision; Speech 
Recognition 

- ROE considerations 
dealing with indirect 
fires/mortars 

- See assess civil 
considerations 

COGNITIVE: 

Written 

Comprehension; 
Deductive Reasoning; 
Inductive Reasoning; 
Problem Sensitivity; 
Visualization; 

SENSORY: 

Near Vision; 

PSYCHOMOTOR: 

None 

- Adjustable ROE 
setting and 
information 

- See assess civil 
considerations 

4 - Very Good 

3 - Good 
*2 - Eair 

1 - Poor 


PSYCHOMOTOR: 

None 


PHYSICAL: 

None 




PHYSICAL: 

None 





Develop a fire support 
plan for the mission 
that considers the use of 
high explosive, smoke 
and illumination 
ordinance and targets 
that support the 
execution of the tactical 
plan 

COGNITIVE: 

Written Expression; 
Deductive Reasoning; 
Eluency of Ideas; 
Originality; Problem 
Sensitivity; Information 
Ordering; Spatial 
Orientation; Speed of 
Closure; Memorization; 

SENSORY: 

Near Vision 

- See assessment for 
develop a light 
infantry CO A. 

- See perform terrain 
analysis 

- Means to graphically 
display fire control 
measures on the area 
of operations 

- Necessary doctrinal 
symbology 

- A means to coordinate 
fire support with 

COGNITIVE: 

Written Expression; 
Deductive Reasoning; 
Eluency of Ideas; 
Originality; Problem 
Sensitivity; Information 
Ordering; Speed of 
Closure; 

SENSORY: 

Near Vision 

PSYCHOMOTOR: 

- See develop a light 
infantry COA 

- See perform terrain 
analysis 

- Ability to place targets 
and task mortars 

- TRP and Illumination 
symbols only 

4 - Very Good 
*3 - Good 

2 - Pair 

1 - Poor 
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PSYCHOMOTOR: 

outside sources if 

Manual Dexterity; 


Manual Dexterity; 

Finger Dexterity; 

required 

Finger Dexterity; 




PHYSICAL: 


PHYSICAL: 

None 


None 



Post-conditions: Fire Support plan is developed; Fire Support Coordination and Control measures are known by the unit; Fire support is integrated into the 
movement and maneuver plan 
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Score: Good 3.00 


Action Item(s): Issue Infantry Company or Company-Team Operations Order 
(OPORD) 

Doctrine: FM 5-0, 3-21.10 

Preconditions: Trainee has received an operations order from his/her higher 
headquarters with supporting materials (e.g., graphics, enemy situational templates); 
Trainee has conducted a preliminary mission analysis on the higher commanders order; 
Trainee has developed a 5-paragraph operations order to provide direction to a unit for 
the execution of a mission. 

Task: 

1. Issue the OPORD Verbally 

2. Issue the OPORD Digitally 


Post-conditions: New information has been transmitted from commander to unit; Unit 
elements acknowledge receipt of OPORD. 


DEFINITION OF SCALE 

4-Very Good —the ITE contains a significant portion (75-100%) of the affordances 
determined during the initial analysis 

3-Good —the ITE contains a good portion (50-74%) of the affordances determined 
during the initial analysis 

2-Fair —the ITE contains some (25-49%) of the affordances determined during the 
initial analysis 

I-Poor —the ITE contains very few (0-24%) of the affordances determined during the 
initial analysis 
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Real World (RW) Preconditions: Trainee has received an operations order 
from his/her higher headquarters with supporting materials (e.g., graphics, 
enemy situational templates); Trainee has conducted a preliminary mission 
analysis on the higher commanders order; rainee has developed a 5-paragraph 
operations order to provide direction to a unit for the execution of a mission. 

Environment Evaluation 

OPORD developed by users of FSC is a matrix style order that does not 
follow doctrinal guidelines. 

RW Tasks 

RW Human Abilities 

RW Affordance 
Requirements 

Environment HA 

Environmental 

Affordances 

Level of Support to 
training 

Issue OPORD verbally 

- Read OPORD 

- Verbally transmit 
information 

COGNITIVE: 

Written 

Comprehension; Oral 
Expression 

SENSORY: 

Near Vision; Speech 
Clarity 

PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity 

PHYSICAL: 

None 

- 5-paragraph OPORD 

- A means to amplify 
the voice so that 
transmission of the 
OPORD may occur if 
the audience is not 
within hearing range 
(e.g., radio) 

COGNITIVE: 

None 

SENSORY: 

Near Vision; 

PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity 

PHYSICAL: 

None 

- Simulated unit 

- No means to verbally 
transmit information 

- Matrix order 

4 - Very Good 
*3 - Good 

2 - Fair 

1 - Poor 

**Task would be rated 
Poor if task elements 
were not treated 
equally. 

Issue OPORD digitally 

COGNITIVE: 

Deductive Reasoning; 

SENSORY: 

Near Vision 

PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity 

PHYSICAL: 

None 

- 5-paragraph OPORD 

- A way to digitally 
deliver or transmit the 
order (e.g., mission 
command system) 

COGNITIVE: 

Deductive Reasoning 

SENSORY: 

Near Vision 

PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity 

PHYSICAL: 

None 

- Simulated digital 
transmission of 

OPORD 

- Simulated unit 

- Matrix order 

4 - Very Good 
*3 - Good 

2 - Fair 

1 - Poor 

Post-conditions: New information has been transmitted from commander to unit; Unit elements acknowledge receipt of OPORD. 
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Score: Fair 2.50 


Action Item: Conduct Reconnaissance 
Doctrine: FM 5-0, 3-21.10 

Preconditions: Trainee receives mission orders (WARNO, FRAGO OPORD) from a 
higher headquarters; Trainee is proficient with the troop leading procedures and METT- 
TC; Trainee has executed steps 1-4 of the TLP; Trainee is familiar with mission analysis. 


Task: Reconnoiter 

1. Trainee identifies areas of his tentative plan where reconnaissance is necessary to 
complete the plan. 

2. Trainee identifies/derives information requirements (IR) 

3. Trainee determines the type of reconnaissance to conduct based on METT-TC 
considerations and IRs. 

a. Physical (i.e., Key leader reconnaissance of the ground) 

b. Materials based reconnaissance (i.e., review of materials provided to him by his 

higher headquarters [e.g., aerial photos, map intelligence]) 

4. Reconnaissance conducted: 

a. Personally by leader 

b. By tasked elements within unit based on IRs. 

5. If trainee assigned elements to conduct reconnaissance, the trainee receives back brief 

on the results of the reconnaissance so that he can complete his plan. 

6. If conducted as part of ongoing operations, trainee repeats steps 3-5 as necessary to 

maintain a current assessment. 


Post-conditions: Reconnaissance of terrain conducted; Reconnaissance of enemy 
conducted; Information requirements developed and distributed 

DEFINITION OF SCALE 

4-Very Good —the ITE contains a significant portion (75-100%) of the affordances 
determined during the initial analysis 

3-Good —the ITE contains a good portion (50-74%) of the affordances determined 
during the initial analysis 

2-Fair —the ITE contains some (25-49%) of the affordances determined during the 
initial analysis 

I-Poor —the ITE contains very few (0-24%) of the affordances determined during the 
initial analysis 
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Real World (RW) Preconditions: Trainee receives mission orders (WARNO, 
FRAGO OPORD) from a higher headquarters; Trainee is proficient with the 
troop leading procedures and METT-TC; Trainee has already executed steps 1- 
4 of the TLP; Trainee is familiar with mission analysis. 

Environment Evaluation 

RW Tasks 

RW Human Abilities 

RW Affordance 
Requirements 

Environment HA 

Environmental 

Affordances 

Level of Support to 
Training 

Trainee identifies areas 
of his tentative plan 
where reconnaissance is 
necessary to complete 
the plan. 

COGNITIVE: 

Deductive Reasoning; 
Inductive Reasoning; 
Problem Sensitivity; 
Visualization; 

Perceptual Speed; Time 
Sharing; Memorization 

SENSORY: 

Near Vision; 

PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity; 

PHYSICAL: 

None 

- See Analyze Enemy 
Situation 

- See Perform Terrain 
Analysis 

- See Develop a Light 
Infantry COA 

- A tentative plan 

COGNITIVE: 

Inductive Reasoning; 
Problem Sensitivity; 
Visualization; 
Memorization 

SENSORY: 

Near Vision; 

PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity; 

PHYSICAL: 

None 

- See Analyze Enemy 
Situation 

- See Perform Terrain 
Analysis 

- See Develop a Light 
Infantry COA 

- No development of a 
reconnaissance plan is 
possible 

- No initial plans are 
developed needing 
reconnaissance 

4 - Very Good 
*3 - Good 

2 - Fair 

1 - Poor 

Trainee identifies and 
derives his information 
requirements (IR) 

COGNITIVE: 

Written Expression; 
Deductive Reasoning; 
Inductive Reasoning; 
Problem Sensitivity; 
Information Ordering; 
Visualization; Spatial 
Orientation; Time 

Sharing; 

SENSORY: 

Near Vision; 

PSYCHOMOTOR: 

- Higher headquarters 
information 
requirements (IR) and 
commanders critical 
information 
requirements (CCIR) 

- See Analyze Enemy 
Situation 

- See Perform Terrain 
Analysis 

- A way to capture IRs 
in words or pictures 

COGNITIVE: 

Written Expression; 
Deductive Reasoning; 
Inductive Reasoning; 
Problem Sensitivity; 
Information Ordering; 
Visualization; Spatial 
Orientation; Time 

Sharing; 

SENSORY: 

Near Vision; 

PSYCHOMOTOR: 

- Scenario can included 
IR’s and CCIRs from 
higher commander 

- See Analyze Enemy 
Situation 

- See Perform Terrain 
Analysis 

- No capability to 
capture IRs in pictures 
or words 

4 - Very Good 
*3 - Good 

2 - Fair 

1 - Poor 
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Manual Dexterity; 

Finger Dexterity; 


Manual Dexterity; 

Finger Dexterity; 




PHYSICAL: 

None 


PHYSICAL: 

None 



Trainee determines the 
type of reconnaissance 
to conduct (e.g., map or 
LDR Recon) based on 
METT-TC 

considerations and IRs 

COGNITIVE: 

Inductive Reasoning; 
Problem Sensitivity; 
Visualization; Spatial 
Orientation; Speed of 
Closure; Time Sharing 

SENSORY: 

Near Vision; 

PSYCHOMOTOR: 

None 

- See Analyze Enemy 
Situation 

- See Perform Terrain 
Analysis 

- The ability to conduct 
all forms of 
reconnaissance 

COGNITIVE: 

Inductive Reasoning 

SENSORY: 

Near Vision; 

PSYCHOMOTOR: 

None 

PHYSICAL: 

None 

- System limited to map 
reconnaissance only 

- See Analyze Enemy 
Situation 

- See Perform Terrain 
Analysis 

4 - Very Good 
*3 - Good 

2 - Fair 

1 - Poor 


PHYSICAL: 

None 





Physical reconnaissance 

COGNITIVE: 

Problem Sensitivity; 
Spatial Orientation; 
Flexibility of Closure; 
Speed of Closure; 
Perceptual Speed; Time 
Sharing 

SENSORY: 

Night Vision; Peripheral 
Vision; Glare 

Sensitivity; Depth 
Perception; Far Vision; 
Near Vision; Visual 

Color Discrimination; 
Auditory Attention; 
Speech Recognition; 

- Environment must 
provide the physical 
and sensory 
information (e.g., 
trees, brush etc.) 
necessary to replicate 
the high physical 
fidelity of conducting 
reconnaissance. Types 
of physical actions 
may include walking, 
crawling, using optics, 
navigation with 
map/GPS etc. 

- Visual and sensory 
information of enemy 
activity for trainee to 

COGNITIVE: 

Problem Sensitivity; 

SENSORY: 

Near Vision; Visual 

Color Discrimination; 

PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity; 

PHYSICAL: 

None 

- System does not 
support physical 
reconnaissance 

4 - Very Good 

3 - Good 

2 - Fair 
*1 - Poor 
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Hearing Sensitivity; 

Sound Localization; 

PSYCHOMOTOR: 

Arm-Hand Steadiness; 
Manual Dexterity; 

Finger Dexterity; 

Control Precision; 
Response Orientation; 
Rate Control; Multilimb 
Coordination; Reaction 
Time; Speed of Limb 
Movement; 

PHYSICAL: 

Static Strength; 

Explosive Strength 
Dynamic Strength; 

Trunk Strength; 

Stamina; Extent 
Elexibility; Gross Body 
Coordination; Gross 

Body Equilibrium 

see and comprehend 

- Replication of friendly 
and enemy equipment 
and personnel 

- Replication of 
operational terrain and 
weather 

- See perform terrain 
analysis 

- See analyze civil 
considerations 




Map Reconnaissance 

COGNITIVE: 

Written 

Comprehension; 

Inductive Reasoning; 
Problem Sensitivity; 
Visualization; Spatial 
Orientation; Elexibility 
of Closure; Speed of 
Closure; Perceptual 

Speed; 

SENSORY: 

Near Vision; 

- Computer automation 
assets (i.e., mission 
command system) if 
used for command and 
control 

- See perform terrain 
analysis 

- See assess enemy 
situation 

COGNITIVE: 

Written 

Comprehension; 

Inductive Reasoning; 
Problem Sensitivity; 
Visualization; Spatial 
Orientation; Elexibility 
of Closure; Speed of 
Closure; 

SENSORY: 

Near Vision; 

PSYCHOMOTOR: 

- Scenario editor allows 
for simple map views 
and simulated visual 
intelligence products 
to be provided to the 
trainee as part of the 
Higher headquarters 
OPORD 

- Game acts as the 
default automation 

asset 

4 - Very Good 
*3 - Good 

2 - Pair 

1 - Poor 
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PSYCHOMOTOR: 

Arm-Hand Steadiness; 
Manual Dexterity; 

Finger Dexterity; 

PHYSICAL: 

None 


Manual Dexterity; 

Finger Dexterity; 

PHYSICAL: 

None 



If trainee assigned 
elements to conduct 
reconnaissance, the 
trainee receives back 
brief on the results of 
the reconnaissance so 
that he can complete his 
plan 

COGNITIVE: 

Oral Comprehension; 
Written 

Comprehension; 

Inductive Reasoning; 
Problem Sensitivity; 
Information Ordering; 
Visualization; Spatial 
Orientation; Speed of 
Closure; Perceptual 
Speed; Memorization; 
Time Sharing; 

SENSORY: 

Near Vision; Speech 
Recognition; 

PSYCHOMOTOR: 

Arm-Hand Steadiness; 
Manual Dexterity; 

Finger Dexterity 

PHYSICAL: 

None 

- Visual products 
associated with the 
reconnaissance 
conducted e.g., maps, 
sketches, and photos 
taken. 

- Computer automation 
to assist visualization 
(e.g., mission 
command system) 

- Verbal reconstruction 
of reconnaissance 
conducted 

COGNITIVE: 

Oral Comprehension; 
Inductive Reasoning; 
Problem Sensitivity; 
Spatial Orientation; 

Speed of Closure; 
Perceptual Speed; 
Memorization; 

SENSORY: 

Near Vision; Speech 
Recognition; 

PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity 

PHYSICAL: 

None 

- Reports from elements 
tasked to execute non¬ 
reconnaissance type 
missions that the 
trainee hopes will 
provide more 
information about the 
enemy 

4 - Very Good 

3 - Good 
*2 - Fair 

1 - Poor 

If conducted as part of 
ongoing operations, 
trainee repeats steps 3-5 
as necessary to maintain 
a current assessment. 






Post-conditions: Reconnaissance of terrain conducted; Reconnaissance of enemy conducted; Information requirements developed and distributed 
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Score: Good 3.00 


Action Item: Develop a Light Infantry Course of Action 
Doctrine: FM 3-21.10; 5-0 

Preconditions: Mission order has been issued and received by the trainee. 


Task: Develop a COA 

1. Analyze relative combat power (strengths and weaknesses) 

2. Generate Options about how to successfully execute the mission 

3. Array Forces available based on the options developed to determine troops to task 

4. Develop a concept of operations that describes how the leader envisions the operation 

unfolding, from its start to its conclusion or end state. 

5. Assign responsibilities for tasks to subordinate elements by name 

6. Prepare a COA statement and sketch that describes the operation 

Post-conditions: COA meets the criteria of being suitable, feasible, acceptable, 
distinguishable, complete. 

DEFINITION OF SCALE 

4-Very Good —the ITE contains a significant portion (75-100%) of the affordances 
determined during the initial analysis 

3-Good —the ITE contains a good portion (50-74%) of the affordances determined 
during the initial analysis 

2-Fair —the ITE contains some (25-49%) of the affordances determined during the 
initial analysis 

I-Poor —the ITE contains very few (0-24%) of the affordances determined during the 
initial analysis 
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Real World (RW) Preconditions: Mission order has been issued and 
received by the trainee. 

Environment Evaluation 

RW Tasks 

RW Human Abilities 

RW Affordance 
Requirements 

Environment HA 

Environmental 

Affordances 

Level of Support to 
training 

Analyze relative combat 
power (strengths, 
weaknesses) 

COGNITIVE: 

Written 

Comprehension; 
Deductive Reasoning; 
Inductive Reasoning; 
Problem Sensitivity; 
Mathematical 

Reasoning; Speed of 
Closure; 

- See Determine own 
force potential combat 
power 

- See Perform Terrain 
Analysis 

- See Assess Enemy 
Situation 

- See Assess Civil 
Considerations 

COGNITIVE: 

Written 

Comprehension; 
Deductive Reasoning; 
Inductive Reasoning; 
Problem Sensitivity; 
Mathematical 

Reasoning; Speed of 
Closure; 

- See Determine own 
force potential combat 
power 

- See Perform Terrain 
Analysis 

- See Assess Enemy 
Situation 

- See Assess Civil 
Considerations 

4 - Very Good 
*3 - Good 

2 - Pair 

1 - Poor 


SENSORY: 

Near Vision; 


SENSORY: 

Near Vision; 




PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity; 


PSYCHOMOTOR: 

Manual Dexterity; 

Einger Dexterity; 




PHYSICAL: 

None 


PHYSICAL: 

None 



Generate Options about 
how to successfully 
execute the mission 

COGNITIVE: 

Fluency of Ideas; 
Originality; Problem 
Sensitivity; Information 
Ordering; Mathematical 
Reasoning; 

Visualization; Speed of 
Closure; Perceptual 
Speed; Memorization; 

SENSORY: 

Near Vision 

PSYCHOMOTOR: 

- See Determine own 
force potential combat 
power 

- See Assess Enemy 
Situation 

- See Perform Terrain 
Analysis 

- See Assess Civil 
Considerations 

- Higher commanders 
intent, desired 
endstate, and critical 
information 

COGNITIVE: 

Written 

Comprehension; 
Deductive Reasoning; 
Inductive Reasoning; 
Problem Sensitivity; 
Mathematical 

Reasoning; Speed of 
Closure; 

SENSORY: 

Near Vision; 

PSYCHOMOTOR: 

- See Determine own 
force potential combat 
power 

- See Assess Enemy 
Situation 

- See Perform Terrain 
Analysis 

- See Assess Civil 
Considerations 

- Scenario editor that 
allows information to 
be added or deleted 
from OPORD 

4 - Very Good 
*3 - Good 

2 - Pair 

1 - Poor 
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Manual Dexterity; 

Finger Dexterity; 

requirements 

Manual Dexterity; 

Finger Dexterity; 




PHYSICAL: 

None 


PHYSICAL: 

None 



Array Forces available 
based on the options 
developed to determine 
troops to task 

COGNITIVE: 

Information Ordering; 
Spatial Orientation; 
Perceptual Speed; 
Memorization; 

SENSORY: 

Near Vision; 

PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity; 

- See Determine own 
force potential combat 
power 

- Tools (a way) that 
allow the trainee to 
arrange/rearrange and 
assign unit elements to 
meet desired 
objectives 

COGNITIVE: 

Written 

Comprehension; 
Deductive Reasoning; 
Inductive Reasoning; 
Problem Sensitivity; 
Mathematical 

Reasoning; Speed of 
Closure; 

SENSORY: 

Near Vision; 

- See Determine own 
force potential combat 
power 

- Game allows trainee 
to assign specific tasks 
to elements based on 
their assets and 
capabilities 

*4 - Very Good 

3 - Good 

2 - Fair 

1 - Poor 


PHYSICAL: 

None 


PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity; 






PHYSICAL: 

None 



Develop a concept of 
operations that 
describes how the 
leader envisions the 
operation unfolding, 
from its start to its 
conclusion or end state 

COGNITIVE: 

Information Ordering; 

Visualization; 

Memorization 

SENSORY: 

Near Vision; 

PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity 

PHYSICAL: 

- Tools to develop a 
framework that allows 
the trainee to describe 
the relationships 
between activities, 
events, and tasks, and 
explains how the tasks 
will lead to 
accomplishing the 
mission. 

- Tools for the trainee to 
use to physically 
depict or sketch out 

COGNITIVE: 

Written 

Comprehension; 

Inductive Reasoning; 
Problem Sensitivity; 
Mathematical 

Reasoning; Speed of 
Closure 

SENSORY: 

Near Vision; 

PSYCHOMOTOR: 

- As part of the planning 
screen under order 
development the 
trainee builds (sketch 
out) an OPORD as a 
COA using symbols 
representing tasks that 
may be assigned to 
units by dragging 
them into the unit’s 
box. 

4 - Very Good 
*3 - Good 

2 - Fair 

1 - Poor 
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None 

their plan in text or 
pictorial form 

Manual Dexterity; 

Finger Dexterity; 






PHYSICAL: 

None 



Assign responsibilities 
for tasks to subordinate 
elements by name 

COGNITIVE: 

Deductive Reasoning; 
Problem Sensitivity; 
Speed of Closure; 
Perceptual Speed; 
Memorization 

SENSORY: 

Near Vision; Speech 
Clarity 

PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity; 

PHYSICAL: 

None 

- A way to assign or 
annotate specific tasks 
or missions to 
subordinate units by 
name in writing 
(words), verbally or 
using pictures or 
symbols. 

COGNITIVE: Written 
Comprehension; 
Deductive Reasoning; 
Inductive Reasoning; 
Problem Sensitivity; 
Mathematical 

Reasoning; Speed of 
Closure; 

SENSORY: 

Near Vision; 

PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity; 

PHYSICAL: 

None 

- Order development 
screen that allows 
trainee to assign tasks 
to units by dragging 
them into the unit’s 
box 

*4 - Very Good 

3 - Good 

2 - Fair 

1 - Poor 

Prepare a COA 
statement and sketch 
that describes the 
operation 

COGNITIVE: 

Written Expression; 
Information Ordering 

SENSORY: 

Near Vision; 

PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity; 

PHYSICAL: 

None 

Tools to build and 
display a COA 
statement and sketch 
that contains: 

- A decisive point, and 
what makes it decisive 

- A form of maneuver 
or type of defensive 
operation 

- Tasks and purposes of 
the decisive, shaping, 
and sustaining 
operations 

COGNITIVE: 

Written 

Comprehension; 
Deductive Reasoning; 
Inductive Reasoning; 
Problem Sensitivity; 
Mathematical 

Reasoning; Speed of 
Closure; 

SENSORY: 

Near Vision; 

PSYCHOMOTOR: 

- Game only provides 
an orders development 
screen where the 
OPORD is entered in 
graphical form. 

4 - Very Good 

3 - Good 

2 - Fair 
*1 - Poor 


292 






- Reserve planning 
priorities 

- Purposes of critical 

WFF elements 

- The desired end state 

- A statement that 
describes the COA 

Manual Dexterity; 

Finger Dexterity; 

PHYSICAL: 

None 



Post-conditions: COA meets the criteria of being suitable, feasible, acceptable, distinguishable, complete 
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Score: Good 3.30 


Action Item: Issue a Fragmentary Order (FRAGO) 

Doctrine: FM 5-0, 3-21.10 

Preconditions: Trainee has developed and issued a plan (WARNO, OPORD) to his unit; 
Original plan requires modifications due to new tactical or operational conditions; 
Elements of order needing adjustment have been identified. 

Task: 

1. Develop a fragmentary order as a result of changes to the original plan 

2. Issue FRAGO verbally 

a. Read FRAGO 

b. Verbally express information 

3. Issue FRAGO as an overlay type order 


Post-conditions: New information has been transmitted from commander to unit; Unit 
elements acknowledge receipt of FRAGO. 


DEFINITION OF SCALE 

4-Very Good —the ITE contains a significant portion (75-100%) of the affordances 
determined during the initial analysis 

3-Good —the ITE contains a good portion (50-74%) of the affordances determined 
during the initial analysis 

2-Fair —the ITE contains some (25-49%) of the affordances determined during the 
initial analysis 

I-Poor —the ITE contains very few (0-24%) of the affordances determined during the 
initial analysis 
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Real World (RW) Preconditions: Trainee has developed and issued a plan 
(WARNO, OPORD) to his unit; Original plan requires modifications due to 
new tactical or operational conditions; Elements of order needing adjustment 
have been identified. 

Environment Evaluation 

RW Tasks 

RW Human Abilities 

RW Affordance 
Requirements 

Environment HA 

Environmental 

Affordances 

Level of Support to 
training 

Develop/draft a 5 
paragraph fragmentary 
order to provide 
direction to units in 
contact as a result of 
changes in battlefield 
conditions. 

COGNITIVE: 

Originality; Problem 
Sensitivity; Information 
Ordering; Visualization; 
Speed of Closure 

SENSORY: 

Near Vision 

PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity 

PHYSICAL: 

None 

- Information that 
indicates that a change 
in the original order is 
necessary 

- 5 paragraph 

Fragmentary Order 
Format 

- A way to place 
necessary information 
into the FRAGO 
format (e.g., typed text 
or hand written) 

COGNITIVE: 

Originality; Problem 
Sensitivity; Information 
Ordering; Visualization; 
Speed of Closure 

SENSORY: 

Near Vision 

PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity 

PHYSICAL: 

None 

- Reports of unit contact 
with the enemy 

- Reports of unit 
accomplishment of 
tasks 

- Doctrinal symbols 
representing tasks 

- Screen that contains 
task symbols and unit 
icon representations 
that allows tasks to be 
dragged and dropped 
onto units 

4 - Very Good 
*3 - Good 

2 - Fair 

1 - Poor 

Issue FRAGO verbally 

- Read FRAGO 

- Verbally Express 
information 

COGNITIVE: 

Written 

Comprehension; Oral 
Expression 

SENSORY: 

Near Vision; Speech 
Clarity 

PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity 

PHYSICAL: 

None 

- FRAGO in a written 
form 

- A means to amplify 
the voice so that 
transmission of the 
FRAGO may occur if 
the audience is not 
within hearing range 
(e.g., radio) 

- Audience for receipt of 
order 

COGNITIVE: 

None 

SENSORY: 

Near Vision; 

PSYCHOMOTOR: 

Manual Dexterity; 

Finger Dexterity 

PHYSICAL: 

None 

- Simulated unit 

- No means to verbally 
transmit information 

4 - Very Good 
*3 - Good 

2 - Fair 

1 - Poor 

** This item would be 
rated as Poor if tasks 
were not considered 
equally important. 

Issue FRAGO digitally 

COGNITIVE: 

- A way to digitally 

COGNITIVE: 

- Simulated digital 

*4 - Very Good 


295 






Information Ordering; 

deliver or transmit the 

Written 

transmission of 

3 - Good 


Spatial Orientation; 

order (e.g., mission 

Comprehension; Oral 

ERAGO information 

2 - Eair 



command system) 

Expression 

to unit 

1 - Poor 


SENSORY: 

- Audience to receive 


- Simulated unit 



Depth Perception; Near 

order 

SENSORY: 




Vision 


Near Vision 




PSYCHOMOTOR: 


PSYCHOMOTOR: 




Arm-Hand Steadiness; 


Manual Dexterity; 




Manual Dexterity; 

Finger Dexterity 


Einger Dexterity 






PHYSICAL: 




PHYSICAL: 

Extent Flexibility 


None 



Post-conditions: New information has been transmitted from commander to unit; Unit elements acknowledge receipt of FRAGO. 
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APPENDIX G. ANALYSIS OF EST 2000 


The following pages provide the analysis conducted on the EST 2000 Heavy 
Weapons simulator located at Fort Hunter Liggett, California. 


Score: 4.43 Very Good 

High Level Task: Engage targets with the MK19 lAW DA FORM 7518-R 
Doctrine: DA FORM 7518-R; FM 3-22.27 

Preconditions: 

1. Trainees have received training and have passed the MK19 fundamental skills test (i.e., 
clearing the weapon, disassembly and assembly of the weapon, functions check, how to 
maintain the weapon, load the weapon, perform immediate actions and unload the 
weapon) 

2. Trainees have received training on how to install, adjust and use the T&E mechanism, 
how to aim the sights of the weapon, proper breathing technique and proper trigger 
squeeze prior to any engagement practice with the weapon. 

3. Preloading procedures have been conducted. 

Task: 

1. LoadMK19 

a. Open cover and insert first round of ammo (female link first) 

b. Push round across the secondary feed pawl 

c. Close cover 

2. Charge MK19 

a. Grasp the charger handles (both sides) with the palms facing down. 

b. Press the charger handle locks in, rotate the handles down and pull them 
sharply to the rear 

c. Return the charger handles forward to their original upright position after 
locking the bolt to the rear 

d. Place safety selector switch on fire and press trigger 

e. Repeat step b 

f. Place safety selector switch to safe 

g. Repeat c 
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3. Aim MK19 at designated targets 

a. Determine range to target 

b. Adjust rear sight as necessary 

c. Check or adjust the T&E mechanism as necessary 

d. Align front and rear sights with target 

4. Engage targets using 3-5 round burst 

a. Grasp handles on back plate assembly 

b. Press butterfly trigger assembly downwards with thumbs 

5. Adjust fire based on strike of rounds 

a. See target hit or go down 

(1) Cease fire 

(2) Move to next target and repeat steps 3-5 until all targets are engaged 

b. See impact of round off target 

(1) Cease fire 

(2) Adjust rear sight or T&E appropriately 

(3) Repeat steps 3-5 until all targets are engaged 

6. Unload MK19 

a. Move safety selector switch to Safe 

b. Open top cover assembly 

c. Eock the bolt to the rear 

d. Remove the ammunition from the feed tray and throat 

7. Clear MK19 

a. Eiring Situation 

(1) Insert a section of cleaning rod or a bayonet through either side of the 
receiver rail 

(2) Close to the bolt face 

(3) Push down on any live cartridge ejecting it 

(4) Eower and pull charging handles to the rear 

(5) Inspect the chamber for rounds 

(6) Place safety selector switch to Eire 

(7) Maintaining rearward pressure on the charging handles press trigger 
and ease bolt forward 

(8) Place safety selector switch to Safe 

b. Non-Eiring Situation 

(1) Place safety selector switch on Safe 

(2) Open top cover assembly 

(3) Eower one or both charger handles 

(4) Pull charger handle slightly to the rear 
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(5) Inspect chamber for rounds 

(6) Ride bolt forward and charging handles to upright position 

Post-conditions: Targets engaged lAW DA FORM 7518-R; Weapon cleared lAW FM 
3-22.27 


DEFINITION OF SCALE 

5-Excellent - the FTE contains all but a few (90-100%) of the affordances determined 
during the analysis 

4-Very Good - the ITE contains a significant portion (70-89%) of the affordances 
determined during the analysis 

3-Good - the ITE contains a good portion (50-69%) of the affordances determined 
during the analysis 

2-Fair - the ITE contains some (25-49%) of the affordances determined during the 
analysis 

I-Poor - the ITE contains very few (0-24%) of the affordances determined during the 
analysis 


Overall Score Computed: 5-i-5-i-4-i-4-i-4-i-5-i-4 = 31/7 = 4.43 
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Real World (RW) Preconditions: Trainees have received training and have 
passed the MK19 fundamental skills test; Trainees have received training on 
how to install, adjust and use the Tc&E mechanism, how to aim the sights of 
the weapon, proper breathing technique and proper trigger squeeze prior to 
any engagement practice with the weapon; Preloading procedures have been 
conducted. 

Environmental Evaluation 

1. Replication of environmental effects not possible outside of visual 
replication on screen of wind or low light conditions. This 
affordance was deemed not present. 

2. The evaluation of the environment took into account the possibility 
that the weapon is used in both a crew served as well as individual 
capacity. 

3. T(&E mechanism not available at the sight of the evaluation. System 
administrator confirmed that the training system T&E is the same as 
the real weapon Tc&E. This feature was not used in calculating the 
evaluation score for the subtask items. 

4. Clearance procedures for the non-firing condition may be fully 
practiced but step ii of the firing condition cannot be met because 
the simulator does not allow for round ejection. 

RW Tasks 

RW Human Abilities 

RW Affordance 
Requirements 

Environment HA 

Environmental 

Affordances 

Level of Support to 
Training 

Load MK19 

a. Open cover and 
insert first round of 
ammo (female link 
first) 

b. Push round across 
the secondary feed 
pawl 

c. Close cover 

COGNITIVE: 

Problem Sensitivity; 
Spatial Orientation; 
Memorization; 

Selective Attention 

SENSORY: 

Night Vision; 

Peripheral Vision; 

Glare Sensitivity; 

Depth Perception; Near 
Vision 

PSYCHOMOTOR: 

Arm-Hand Steadiness; 
Manual Dexterity; 

Finger Dexterity; 
Multilimb 

Coordination; 

PHYSICAL: 

- Weapon resemblance 
with a receiver, bolt, 
working cover and 
cover latch 

- Ammunition belt with 
a resemblance of 
ammunition and 
female and male links 

- A resemblance of the 
feed pawls located in 
the proper locations as 
on the real weapon 

- Ambient or other 
lighting that allows 
the viewing of the 
feed pawls for loading 

- Training space where 
weapon resemblance 
and ammunition are 
available 

- A stand or mount that 

COGNITIVE: 

Problem Sensitivity; 
Information Ordering; 
Spatial Orientation; 
Perceptual Speed; 
Memorization; 

SENSORY: 

Night Vision; 

Peripheral Vision; 

Depth Perception; Near 
Vision; 

PSYCHOMOTOR: 

Arm-Hand Steadiness; 
Manual Dexterity; 

Finger Dexterity; 
Multilimb 

Coordination; 

PHYSICAL: 

- All Present 

*5 - Excellent 

4 - Very Good 

3 - Good 

2 - Fair 

1 - Poor 
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Extent Flexibility 

holds the weapon 
resemblance in a 
proper position for 
loading, unloading 
firing and clearing 
activities 

Static Strength; Extent 
Flexibility 



Charge MK19 

a. Grasp the charger 
handles (both 
sides) with the 
palms facing down 

b. Press the charger 
handle locks in, 
rotate the handles 
down and pull 
them sharply to the 
rear 

c. Return the charger 
handles forward to 
their original 
upright position 
after locking the 
bolt to the rear 

d. Place safety 
selector switch on 
fire and press 
trigger 

e. Repeat step b 

f Place safety 

selector switch to 
safe 

g. Repeat c 

COGNITIVE: 

Problem Sensitivity; 
Information Ordering; 
Spatial Orientation; 
Memorization 

SENSORY: 

Night Vision; 

Peripheral Vision; 

Glare Sensitivity; 

Depth Perception; Near 
Vision 

PSYCHOMOTOR: 

Arm-Hand Steadiness; 
Manual Dexterity; 

Finger Dexterity; 
Multilimb Coordination 

PHYSICAL: 

Static Strength; Trunk 
Strength; Extent 
Flexibility 

- Weapon resemblance 
that is an appropriate 
weight with 2 
charging handles one 
on either side of the 
weapon receiver 

- Charging handles 
provide haptic and 
proprioceptive 
feedback and range of 
motion similar to 
those of the MK19 

- Weapon bolt 
resemblance that 
moves within the 
receiver resemblance 
that can be locked to 
the rear of the receiver 

- Resemblance of a 
Fire/Safe lever on the 
backplate of the 
weapon resemblance 
that provides haptic, 
proprioceptive and 
visual feedback of 
location (setting) 

- A stand or mount that 
holds the weapon 
resemblance in a 
proper position for 
loading, unloading. 

COGNITIVE: 

Oral Expression; Oral 
Comprehension; 

Problem Sensitivity; 
Information Ordering; 
Spatial Orientation; 
Memorization; 

SENSORY: 

Night Vision; 

Peripheral Vision; 

Depth Perception; Near 
Vision; 

PSYCHOMOTOR: 

Arm-Hand Steadiness; 
Manual Dexterity; 

Finger Dexterity; 
Multilimb 

Coordination; 

PHYSICAL: 

Static Strength; Trunk 
Strength; Extent 
Flexibility; 

- All Present 

*5 - Excellent 

4 - Very Good 

3 - Good 

2 - Fair 

1 - Poor 
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firing and clearing 
activities 

- A butterfly type 
trigger resemblance 
located between two 
handles on the 
weapon receiver 
resemblance 
backplate 




AimMK19 at 

designated targets 

a. Determine range to 
target 

b. Adjust rear sight as 
necessary 

c. Check or adjust the 
T(&E mechanism 
as necessary 

d. Align front and 
rear sights with 
target 

COGNITIVE: 

Problem Sensitivity; 
Spatial Orientation; 
Perceptual Speed; 
Memorization; Time 
Sharing; 

SENSORY: 

Night Vision; 

Peripheral Vision; 

Glare Sensitivity; 

Depth Perception; Far 
Vision; Near Vision; 
Visual Color 
Discrimination 

PSYCHOMOTOR: 

Arm-Hand Steadiness; 
Manual Dexterity; 

Finger Dexterity; 

Control Precision; 
Multilimb 

Coordination; Reaction 
Time 

PHYSICAL: 

None 

- A stand or mount that 
holds the weapon 
resemblance in a 
proper position for 
loading, unloading, 
firing and clearing 
activities that is 
movable and 
adjustable 

- Targets that resemble 
enemy vehicles or 
personnel that are 
engageable (i.e., 
within range and 
viewable). 

- Targets must afford 
range estimation 
activity 

- Adjustable rear sight 
for range estimation 

- Traversing and 
Elevation mechanism 

- Front sight 
resemblance 

- Adequate lighting to 
see targets and sights 

- 2 vertical handles 

COGNITIVE: 

Oral Expression; Oral 
Comprehension; 
Inductive Reasoning; 
Problem Sensitivity; 
Information Ordering; 
Spatial Orientation; 
Flexibility of Closure; 
Perceptual Speed; 
Memorization; 

SENSORY: 

Night Vision; 

Peripheral Vision; 

Depth Perception; Far 
Vision; Near Vision; 
Visual Color 
Discrimination; 

PSYCHOMOTOR: 

Arm-Hand Steadiness; 
Manual Dexterity; 

Finger Dexterity; 

Control Precision; 
Multilimb 

Coordination; 

Reaction Time 

- Tripod present for 
weapon mounting 

- Targets lAW 7518-R 

- Targets allow for 
range estimation 

- Rear sight is fully 
adjustable 

- T(&E mechanism not 
available for this 
evaluation 

- Front Sight available 

- Adequate lighting 
present 

- Handles present 

- No replication of 
environmental effects 

5 - Excellent 
*4 - Very Good 

3 - Good 

2 - Fair 

1 - Poor 
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located on the back of 
the weapon 
resemblance that 
allow it to be 
horizontally and 
vertically manipulated 
- Replication of 
environmental 
weather concerns or 
attributes (e.g., heat 
waves, cold, rain, 
wind effects) 

PHYSICAL: 

None 



Engage targets using 3- 

5 round burst 

a. Grasp handles on 
back plate 
assembly 

b. Press butterfly 
trigger assembly 
downwards with 
thumbs 

COGNITIVE: 

Number Facility; 

Spatial Orientation; 
Perceptual Speed; 
Memorization 

SENSORY: 

Night Vision; 

Peripheral Vision; 

Glare Sensitivity; 

Depth Perception; Far 
Vision; Near Vision; 
Visual Color 
Discrimination 

PSYCHOMOTOR: 

Arm-Hand Steadiness; 
Manual Dexterity; Rate 
Control; Multilimb 
Coordination; Reaction 
Time; 

PHYSICAL: 

Dynamic Strength; 

Trunk Strength; 

- Haptic and 
proprioceptive 
feedback (recoil) 
similar to that of the 
real weapon that 
provides feedback on 
the number of rounds 
that have been fired 

- 2 vertical handles 
located on the back of 
the weapon 
resemblance that 
allow it to be 
horizontally and 
vertically manipulated 

- A butterfly type 
trigger resemblance 
located between the 
two vertical handles 
on the back of the 
weapon resemblance 

- Appropriate light for 
seeing targets and 
sights 

- Auditory feedback 

COGNITIVE: 

Number Facility; 

Problem Sensitivity; 
Information Ordering; 
Spatial Orientation; 
Flexibility of Closure; 
Memorization; 

SENSORY: 

Night Vision; 

Peripheral Vision; 

Depth Perception; Far 
Vision; Near Vision; 
Visual Color 
Discrimination; 

PSYCHOMOTOR: 

Arm-Hand Steadiness; 
Manual Dexterity; Rate 
Control; Finger 

Dexterity; Multilimb 
Coordination; 

PHYSICAL: 

Dynamic Strength; 

- Haptic and 
proprioceptive 
feedback of recoil 
very similar to real 
weapon and 
adjustable 

- Vertical handles 
present 

- Butterfly trigger 
present 

- Appropriate light for 
seeing targets and 
sights available 

- Auditory feedback 
(noise) from weapon 
resemblance firing 
and functioning 
present 

- No Replication of 
environmental 
weather concerns or 
attributes (e.g., heat 
waves, cold, rain, 
wind effects) 

5 - Excellent 
*4 - Very Good 

3 - Good 

2 - Fair 

1 - Poor 
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Stamina; Extent 
Elexibility; 

(noise) from weapon 
resemblance firing 
and functioning 
- Replication of 
environmental 
weather concerns or 
attributes (e.g., heat 
waves, cold, rain, 
wind effects) 

Trunk Strength; 

Stamina; Extent 
Plexibility 



Adjust fire based on 
strike of rounds 
a. See target hit or go 
down 

i. Cease fire 

ii. Move to next 
target and 
repeat steps 3-5 
until all targets 
are engaged 

b. See impact of round 
off target 

i. Cease fire 

ii. Adjust rear sight 
or T&E 
appropriately 

iii. Repeat steps 3-5 
until all targets 
are engaged 

COGNITIVE: 

Deductive Reasoning; 
Inductive Reasoning; 
Problem Sensitivity; 
Memorization; 

Selective Attention; 

Time Sharing 

SENSORY: 

Night Vision; 

Peripheral Vision; 

Glare Sensitivity; 

Depth Perception; Par 
Vision; Near Vision; 
Visual Color 
Discrimination; 

Hearing Sensitivity 

PSYCHOMOTOR: 

Arm-Hand Steadiness; 
Manual Dexterity; 

Pinger Dexterity; Rate 
Control; Multilimb 
Coordination; Wrist- 
Pinger Speed; Reaction 
Time; 

PHYSICAL: 

- Visual feedback of 
target status (e.g., 
target goes down, 
explodes, stops; 
kicked up dirt) 

- Auditory feedback 
(noise) from weapon 
resemblance firing 
and functioning 

- Recoil from weapon 
firing 

- A way to traverse and 
elevate the weapon 
resemblance 

- Replication of 
environmental 
weather concerns or 
attributes (e.g., heat 
waves, cold, rain, 
wind effects) 

- Adjustable rear sight 
for range estimation 

- Pront sight 
resemblance 

COGNITIVE: 

Oral Expression; Oral 
Comprehension; 
Deductive Reasoning; 
Inductive Reasoning; 
Problem Sensitivity; 
Information Ordering; 
Spatial Orientation; 
flexibility of Closure; 
Perceptual Speed; 
Memorization; 

SENSORY: 

Night Vision; 

Peripheral Vision; 

Depth Perception; Par 
Vision; Near Vision; 
Visual Color 
Discrimination; 

PSYCHOMOTOR: 

Arm-Hand Steadiness; 
Manual Dexterity; 

Pinger Dexterity; 
Multilimb 

Coordination; Reaction 
Time; 

- Target obscuration is 
not an available 
feature during 
qualification tables. 
Obscuration is 
possible when 
shooting other 
scenarios. Disturbed 
dirt does dissipate. 

- Targets went down 
when struck with 
rounds. 

- Recoil of weapon 
adjustable and 
appropriate 

- Noise from weapon 
firing adjustable and 
appropriate 

- Pront and rear sights 
present 

- It is possible to 
traverse and elevate 
the weapon. 

- No physical 
replication of weather 
effects 

5 - Excellent 
*4 - Very Good 

3 - Good 

2 - Pair 

1 - Poor 
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Dynamic Strength; 

Trunk Strength; 

Stamina; Extent 
Flexibility; 


PHYSICAL: Dvnamic 
Strength; Extent 
Flexibility; 



Unload MK19 

a. Move safety 
selector switch to 
Safe 

b. Open top cover 
assembly 

c. Lock the bolt to the 

rear 

d. Remove the 
ammunition from 
the feed tray and 
throat 

COGNITIVE: 

Problem Sensitivity; 
Spatial Orientation; 
Memorization; 

Selective Attention 

SENSORY: 

Night Vision; 

Peripheral Vision; 

Glare Sensitivity; 

Depth Perception; Near 
Vision 

PSYCHOMOTOR: 

Arm-Hand Steadiness; 
Manual Dexterity; 

Finger Dexterity; 
Multilimb Coordination 

PHYSICAL: 

Static Strength; Trunk 
Strength; Extent 
Flexibility 

- Weapon resemblance 
with working cover 
and cover latch 

- Ammunition belt with 
resemblance of 
ammunition and 
female and male links 

- A resemblance of the 
feed pawls located in 
the proper locations as 
on the real weapon 

- Ambient or other 
lighting that allows 
the viewing of the 
feed pawls for loading 

- Training space where 
weapon resemblance 
and ammunition are 
available 

- Weapon resemblance 
that is the appropriate 
weight with 2 
charging handles one 
on either side of the 
weapon receiver 

- Charging handles 
provide the correct 
haptic and 
proprioceptive 
feedback and range of 
motion as those of a 
MK19 

COGNITIVE: 

Oral Expression; Oral 
Comprehension; 

Problem Sensitivity; 
Information Ordering; 
Spatial Orientation; 
Perceptual Speed; 
Memorization; 

SENSORY: 

Night Vision; 

Peripheral Vision; 

Depth Perception; Far 
Vision; Near Vision; 

PSYCHOMOTOR: 

Arm-Hand Steadiness; 
Manual Dexterity; 

Finger Dexterity; 
Multilimb 

Coordination; 

PHYSICAL: 

Static Strength; Extent 
Flexibility; 

- All Present 

*5 - Excellent 

4 - Very Good 

3 - Good 

2 - Fair 

1 - Poor 
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- Weapon bolt 
resemblance that 
moves within the 
receiver resemblance 
that can be locked to 
the rear of the receiver 

- Resemblance of a 
Fire/Safe lever on the 
backplate of the 
weapon resemblance 
that provided haptic, 
proprioceptive and 
visual feedback of 
location (setting) 




Clear MK19 
a. Firing Situation 

i. Insert a section 
of cleaning rod 
or a bayonet 
through either 
side of the 
receiver rail 
close to the bolt 
face 

ii. Push down on 
any live 
cartridge 
ejecting it 

iii. Lower and pull 
charging handles 
to the rear 

iv. Inspect the 
chamber for 
rounds 

V. Place safety 
selector switch 
to Fire 

COGNITIVE: 

Problem Sensitivity; 
Spatial Orientation; 
Memorization; 

Selective Attention; 

SENSORY: 

Night Vision; 

Peripheral Vision; 

Glare Sensitivity; 

Depth Perception; Near 
Vision 

PSYCHOMOTOR: 

Arm-Hand Steadiness; 
Manual Dexterity; 

Finger Dexterity; 
Multilimb Coordination 

PHYSICAL: 

Static Strength; Trunk 
Strength; Extent 
Flexibility 

- Resemblance of 
weapon receiver with 
handles, bolt 
mechanism and cover 
that function similarly 
to the real weapons 
bolt, receiver and 

cover 

- Resemblance of an 
ammunition belt and 
rounds that fit 
properly into the 
weapon resemblance 
receiver. 

- Receiver allows the 
ammunition 
resemblance to be 
ejected in the manner 
described 

- Charging handles that 
provide similar haptic 
and proprioceptive 
feedback and range of 

COGNITIVE: 

Oral Expression; Oral 
Comprehension; 
Deductive Reasoning; 
Inductive Reasoning; 
Problem Sensitivity; 
Information Ordering; 
Spatial Orientation; 
Perceptual Speed; 
Memorization; 

SENSORY: 

Night Vision; 

Peripheral Vision; 

Depth Perception; Par 
Vision; Near Vision; 
Visual Color 
Discrimination; 

Auditory Attention; 
Speech Recognition; 

PSYCHOMOTOR: 

Arm-Hand Steadiness; 

- Weapon receiver 
appropriate 

- Ammo belt present 

- Rounds cannot be 
ejected as described in 
step ii. No ejecting of 
rounds is possible 
with the simulator. 

- Charging handles 
present and 
appropriate 

- Lighting appropriate 

- Pire/Safe Lever 
present 

- Triggers present 

- Cleaning rod/Bayonet 
not present as firing 
condition for clearing 
is not possible 

5 - Excellent 
*4 - Very Good 

3 - Good 

2 - Pair 

1 - Poor 
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vi. Maintaining 
rearward 
pressure on the 
charging handles 
press trigger and 
ease bolt forward 

vii. Place safety 
selector switch 
to Safe. 

b. Non-Firing 

Situation 

i. Place safety 
selector switch 
on Safe 

ii. Open top cover 
assembly 

iii. Lower one or 
both charger 
handles 

iv. Pull charger 
handle slightly to 
the rear 

V. Inspect chamber 
for rounds 
vi. Ride bolt 
forward and 
charging handles 
to upright 
position 


motion to that of the 
real weapon 

- Ambient lighting that 
allows for the 
chamber to be viewed 
and rounds detected 

- Resemblance of a 
cleaning rod or 
bayonet that is 
insertable into the 
receiver of the 
weapon resemblance 

- Resemblance of a 
Fire/Safe lever on the 
backplate of the 
weapon resemblance 
that provided haptic, 
proprioceptive and 
visual feedback of 
location (setting) 

- Butterfly type trigger 
located between the 
handles on the 
backplate 

Manual Dexterity; 

Finger Dexterity; 
Multilimb 

Coordination; Reaction 
Time; 

PHYSICAL: 

Static Strength; Trunk 
Strength; Extent 
Flexibility; 



Post-conditions: Targets engaged lAW DA FORM 7518-R; Weapon cleared lAW FM 3-22.27 
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Score: 4.00 Very Good 


High level Task: Engage targets with the M2 HB MG lAW DA Form 7449-R 
Doctrine: FM 3-22.65, DA Form 7449-R 

Preconditions: 

F Trainees have received training and have passed the M2 HB MG fundamental skills 
test (i.e., clearing the machine gun, disassembly and assembly of the machine gun, 
functions check, how to maintain the machine gun, set the headspace and timing, load the 
machine gun, perform immediate actions and unload the machine gun). 

2. Trainees have received training on how to install, adjust and use the T&E mechanism, 
how to aim the sights of the weapon, proper breathing technique and proper trigger 
squeeze prior to any engagement practice with the weapon. 

Tasks: 

1. FoadM2 

a. Open machine gun cover and insert ammo belt 

b. Close cover 

c. Pull retracting handle to the rear locking the bolt in the rear position 

d. Release handle 

2. Charge M2 

a. Pull charging handle to the rear of the weapon 

3. Aim M2 at designated targets 

a. Determine range to target 

b. Adjust or check adjustment of T&E mechanism 

c. Align front and rear sights with target 

4. Engage targets using 5-7 round burst 

a. Grasp handles on back plate 

b. Press butterfly trigger assembly with thumbs 

5. Adjust fire based on strike of rounds 

a. See target hit or go down 

(1) Cease fire 

(2) Move to next target and repeat steps 3-5 until all targets are engaged 

b. See impact of round off target 

(1) Adjust rear sight and T&E appropriately 

(2) Repeat steps 3-5 until all targets are engaged 

6. Unload Weapon 

a. Ensure weapon is in single shot mode 
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b. Lift machine gun cover 

c. Remove ammo belt 

d. Lock bolt to the rear of receiver 

7. Clear Weapon 

a. With bolt locked to the rear examine chamber and T-Slot for rounds 

b. Insert cleaning rod into muzzle end of barrel and push to bore until visible 

c. Remove cleaning rod from barrel 

d. Press trigger 


Post-conditions: Targets engaged per DA Form 7449-R; Engagements completed 

DEFINITION OF SCALE 

5-Excellent - the LTE contains all but a few (90-100%) of the affordances determined 
during the analysis 

4-Very Good - the ITE contains a significant portion (70-89%) of the affordances 
determined during the analysis 

3-Good - the ITE contains a good portion (50-69%) of the affordances determined 
during the analysis 

2-Fair - the ITE contains some (25-49%) of the affordances determined during the 
analysis 

I-Poor - the ITE contains very few (0-24%) of the affordances determined during the 
analysis 

Result: Overall Score 4 (4+4+4+4+4+5+3) = 28/7 = 4 
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Real World (RW) Preconditions: Trainees have received training and have 
passed the M2 HB MG fundamental skills test; Trainees have received 
training on how to install, adjust and use the Tc&E mechanism, how to aim the 
sights of the weapon, proper breathing technique and proper trigger squeeze 
prior to any engagement practice with the weapon. 

Environmental Evaluation 

1. Replication of environmental effects not possible outside of visual 
replication on screen of wind or low light conditions. This affordance was 
deemed not present. 

2. The evaluation of the environment took into account the possibility that 
the weapon is used in both a crew served as well as individual capacity. 

3. T&E mechanism not available at the sight of the evaluation. System 
administrator confirmed that the training system Tc&E is the same as the 
real weapon T&E. This feature was not used in calculating the evaluation 
score for the sub task items. 

RW Tasks 

RW Human Abilities 

RW Affordance 
Requirements 

Environment HA 

Environmental 

Affordances 

Level of Support to 
Training 

Load M2 

a. Open machine gun 
cover and insert 
ammo belt 

b. Close cover 

c. Pull retracting 
handle to the rear 
locking the bolt in 
the rear position 

d. Release handle 

COGNITIVE: 

Problem Sensitivity; 
Information Ordering; 
Spatial Orientation 
Perceptual Speed; 
Memorization 

SENSORY: 

Night Vision; 

Peripheral Vision; Glare 
Sensitivity; Depth 
Perception; Near 

Vision; Hearing 
Sensitivity 

PSYCHOMOTOR: 

Arm-Hand Steadiness; 
Manual Dexterity; 

Finger Dexterity; 
Multilimb 

Coordination; 

PHYSICAL: 

Static Strength; Extent 
Flexibility 

- Resemblance of M2 
upper receiver with a 
cover that may be 
opened by turning a 
releasing lever on the 
left side of the cover; 
an ammunition 
feedway with belt¬ 
holding pawls that 
afford the ammunition 
belt to be held in place 
and extractor 

- A resemblance of an 
ammunition belt with 
double and single loop 
ammo links 

- A handle on the right 
side of the M2 
resemblance that may 
be grasped and moves 
horizontally from front 
to rear and back to 
front that provides 
haptic feedback 
(pressure and force) 

COGNITIVE: 

Problem Sensitivity; 
Information Ordering; 
Spatial Orientation; 
Perceptual Speed; 
Memorization; 

SENSORY: 

Night Vision; 

Peripheral Vision; 

Depth Perception; Near 
Vision; 

PSYCHOMOTOR: 

Arm-Hand Steadiness; 
Manual Dexterity; 

Finger Dexterity; 
Multilimb 

Coordination; 

PHYSICAL: 

Static Strength; Extent 
Flexibility; 

- Demilitarized .50 
caliber machine gun 
with working upper 
receiver, bolt and 

cover. 

- Training ammunition 
with male and female 
linkage 

- No feed pawls to catch 
ammunition belt or 
extractor present. 
Rounds stayed in 
place without pawls or 
extractor. 

- Handle on right side of 
M2 that moved and 
provided proper haptic 
feedback 

5 - Excellent 
*4 - Very Good 

3 - Good 

2 - Fair 

1 - Poor 
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similar to that of the 
real weapon 
- Resemblance of bolt 
action moving from 
front to rear of weapon 
when handle engaged 




Charge M2 

a. Pull charging 
handle to the rear 
of the weapon 

COGNITIVE: 

Information Ordering; 
Spatial Orientation; 
Memorization 

SENSORY: 

Night Vision; Glare 
Sensitivity; Depth 
Perception; Near Vision 

PSYCHOMOTOR: 

Arm-Hand Steadiness; 
Manual Dexterity; 

Finger Dexterity; 
Multilimb 

Coordination; 

PHYSICAL: 

Static Strength; Extent 
Flexibility 

- M2 upper receiver 
resemblance with 
backplate handles that 
may be grasped with 
one or both hands 

- A handle on the right 
side of the M2 
resemblance that 
moves back and forth 
that provides haptic 
feedback (pressure and 
force) similar to that 
of the real weapon 

- Haptic resemblance of 
the bolt action moving 
within the weapon 
when the handle is 
engaged 

- Ability to visually 
detect the ejection of 
ammunition links, 
casings or rounds from 
the right side of the 
ammunition feedway 
of the device when the 
device is charged 

COGNITIVE: 

Information Ordering; 
Spatial Orientation; 
Memorization; 

SENSORY: 

Night Vision; 

Peripheral Vision; 

Depth Perception; Near 
Vision; 

PSYCHOMOTOR: 

Arm-Hand Steadiness; 
Manual Dexterity; 

Finger Dexterity; 
Multilimb 

Coordination; 

PHYSICAL: 

Static Strength; Extent 
Flexibility; 

- Receiver present with 
backplate handles 

- Handle on right side of 
M2 that functioned as 
on the real weapon 
with proper haptic 
feedback 

- Bolt action in receiver 
accurate and 
appropriate 

- No spent ammunition 
or links are ejected 
when the weapon is 
charged or fired. 

5 - Excellent 
*4 - Very Good 

3 - Good 

2 - Fair 

1 - Poor 

Aim M2 at designated 
targets 

a. Determine range to 
target 

COGNITIVE: 

Information Ordering; 
Spatial Orientation; 
Perceptual Speed; 
Memorization 

- M2 resemblance with 
backplate handles that 
may be grasped with 
one or both hands and 
moved so that it can 

COGNITIVE: 

Oral Expression; Oral 
Comprehension; 

Inductive Reasoning; 
Problem Sensitivity; 

- M2 resemblance with 
backplate handles 
graspable with both 
hands 

5 - Excellent 
*4 - Very Good 

3 - Good 

2 - Fair 

1 - Poor 
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b. Adjust or check 
adjustment of Tc&E 
mechanism 

c. Align front and rear 
sights with target 

SENSORY: 

Night Vision; 

Peripheral Vision; Glare 
Sensitivity; Depth 
Perception; Par Vision; 
Near Vision; Visual 

Color Discrimination 

PSYCHOMOTOR: 

Arm-Hand Steadiness; 
Manual Dexterity; 

Pinger Dexterity; 

Control Precision; 
Multilimb Coordination 
Reaction Time 

PHYSICAL: 

None 

be aligned with the 
target 

- Rear peep site and 
front sight blade that 
resemble those found 
on the M2 

- The rear sight 
assembly is adjustable 
for range estimation 

- Targets designed and 
displayed lAW DA 
Porm 7449-R that are 
recognizable and 
visible to the trainee 

- A way to traverse and 
elevate the weapon 
resemblance 

- Tripod or mount for 
weapon resemblance 
to be mounted on 

- Replication of 
environmental weather 
concerns or attributes 
(e.g., heat waves, cold, 
rain, wind effects) 

Information Ordering; 
Spatial Orientation; 
Plexibility of Closure; 
Perceptual Speed; 
Memorization; 

SENSORY: 

Night Vision; 

Peripheral Vision; 

Depth Perception; Par 
Vision; Near Vision; 
Visual Color 
Discrimination 

PSYCHOMOTOR: 

Arm-Hand Steadiness; 
Manual Dexterity; 

Pinger Dexterity; 

Control Precision; 
Multilimb 

Coordination; 

Reaction Time; 

PHYSICAL: 

None 

- Rear peep site and 
front sight blade 

- Rear sight assembly is 
adjustable for range 
estimation 

- Targets are displayed 
and designed lAW DA 
Porm 7449-R and are 
recognizable and 
visible 

- Evaluated system was 
on a tripod, which 
allowed for traversing 
and elevation of the 
weapon 

- Tripod present 

- Display of some 
environmental effects 
conditions such as fog, 
night and wind were 
possible with the EST 
computer. No 
replication of actual 
weather is possible in 
the building used for 
training. 


Engage targets using 5- 

7 round burst 

a. Grasp handles on 
back plate 

b. Press butterfly 
trigger assembly 
with thumbs 

COGNITIVE: 

Information Ordering; 
Memorization 

SENSORY: 

Night Vision; 

Peripheral Vision; Glare 
Sensitivity; Depth 
Perception; Par Vision; 
Near Vision; Visual 

- Trigger that affords 
engagement with 
thumbs and haptic 
feedback to trainee 
when thumb pressure 
is applied 

- Handles that afford 
grasping vertically 

- Recoil from weapon 

COGNITIVE: 

Problem Sensitivity; 
Information Ordering; 
Spatial Orientation; 
Plexibility of Closure; 
Memorization; 

SENSORY: 

Night Vision; 

Peripheral Vision; 

- Proper trigger 
assembly present 

- Handles present 

- Recoil adjustable and 
appropriate 

- Noise adjustable and 
appropriate 

- Visual obscuration 
effects were minimal 

5 - Excellent 
*4 - Very Good 

3 - Good 

2 - Pair 

1 - Poor 
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Color Discrimination 

PSYCHOMOTOR: 

Arm-Hand Steadiness; 
Manual Dexterity; 

Finger Dexterity; 
Multilimb Coordination 

PHYSICAL: 

Dynamic Strength; 

Trunk Strength; 

Stamina; Extent 
Flexibility 

firing 

- Noise from weapon 
firing 

- Obscuration from 
weapon firing (e.g., 
smoke, dirt) 

- Sound delineating 
individual rounds 
firing so that 5-7 
round bursts may be 
identified by firer 

- Replication of 
environmental weather 
concerns or attributes 
(e.g., heat waves, cold, 
rain, wind effects) 

Depth Perception; Far 
Vision; Near Vision; 
Visual Color 
Discrimination; 
PSYCHOMOTOR: 
Arm-Hand Steadiness; 
Manual Dexterity; 

Finger Dexterity; 
Multilimb 

Coordination; 

PHYSICAL: 

Dynamic Strength; 

Trunk Strength; 

Stamina; Extent 
Flexibility 

(e.g., dirt from strike 
of round) 

- Sound of firing 
seemed slightly fast 
but appropriate 

- No physical 
replication of 
environmental effects 
only visual 


Adjust fire based on 
strike of rounds 

a. See target go down 

i. Cease fire 

ii. Move to next 
target and repeat 
#5 

b. See impact of 
round off target 

i. Adjust elevation, 
range or 
horizontal 
position 

ii. Repeat #5 

COGNITIVE: 

Inductive Reasoning; 
Problem Sensitivity; 
Spatial Orientation; 

Speed of Closure; 
Perceptual Speed; 
Memorization; 

SENSORY: 

Night Vision; 

Peripheral Vision; Glare 
Sensitivity; Depth 
Perception; Far Vision; 
Near Vision; Visual 

Color Discrimination; 

PSYCHOMOTOR: 

Arm-Hand Steadiness; 

- Dissipation of target 
obscuration (e.g., 
smoke, dirt) 

- Visual feedback that 
target has been struck 
(i.e., bullet hole, target 
falling, dirt kicked up 
near target) 

- Replication of 
environmental weather 
concerns or attributes 
(e.g., heat waves, cold, 
rain, wind effects) 

- Recoil from weapon 
firing 

- Noise from weapon 
firing 

- A way to traverse and 

COGNITIVE: 

Oral Expression; Oral 
Comprehension; 
Deductive Reasoning; 
Inductive Reasoning; 
Problem Sensitivity; 
Information Ordering; 
Spatial Orientation; 
Flexibility of Closure; 
Perceptual Speed; 
Memorization; 

SENSORY: 

Night Vision; 

Peripheral Vision; 

Depth Perception; Far 
Vision; Near Vision; 
Visual Color 

- Target obscuration is 
not an available 
feature during 
qualification tables. 
Obscuration is 
possible when 
shooting other 
scenarios. Disturbed 
dirt does dissipate. 

- Targets went down 
when struck with 
rounds. 

- No physical 
replication of weather 
effects 

- Recoil of weapon 
adjustable 

- Noise from weapon 

5 - Excellent 
*4 - Very Good 

3 - Good 

2 - Fair 

1 - Poor 
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Manual Dexterity; 

Linger Dexterity; 
Multilimb 

Coordination; Reaction 
Time; 

PHYSICAL: 

Dynamic Strength; 

Extent Llexibility 

elevate the weapon 
resemblance 

Discrimination; 

PSYCHOMOTOR: 

Arm-Hand Steadiness; 
Manual Dexterity; 

Linger Dexterity; 
Multilimb 

Coordination; Reaction 
Time 

PHYSICAL: 

Dynamic Strength; 

Extent Llexibility; 

firing adjustable 
- It is possible to 
traverse and elevate 
the weapon. 


Unload Weapon 

COGNITIVE: 

- Resemblance of M2 

COGNITIVE: 

- Resemblance of M2 

*5 - Excellent 


Problem Sensitivity; 

upper receiver with a 

Oral Expression; Oral 

upper receiver with a 

4 - Very Good 

a. Ensure weapon is 

Information Ordering; 

cover that may be 

Comprehension; 

cover that may be 

3 - Good 

in single shot mode 

Spatial Orientation; 

opened by turning a 

Problem Sensitivity; 

opened by turning a 

2 - Pair 

b. Lift machine gun 

Perceptual Speed; 

releasing lever on the 

Information Ordering; 

releasing lever on the 

1 - Poor 

cover 

Memorization; 

left side of the cover; 

Spatial Orientation; 

left side of the cover; 


c. Remove ammo belt 


an ammunition 

Perceptual Speed; 

an ammunition 


d. Lock bolt to the 

SENSORY: 

feedway with belt¬ 

Memorization; 

feedway with belt¬ 


rear of receiver 

Night Vision; 

holding pawls that 


holding pawls that 



Peripheral Vision; Glare 

afford the ammunition 

SENSORY: 

afford the ammunition 



Sensitivity; Depth 

belt to be held in place 

Night Vision; 

belt to be held in place 



Perception; Near 

- A resemblance of an 

Peripheral Vision; 

- A resemblance of an 



Vision; Hearing 

ammunition belt with 

Depth Perception; Par 

ammunition belt with 



Sensitivity 

double and single loop 

Vision; Near Vision; 

double and single loop 




ammo links 


ammo links 



PSYCHOMOTOR: 

- A handle on the right 

PSYCHOMOTOR: 

- A handle on the right 



Arm-Hand Steadiness; 

side of the M2 

Arm-Hand Steadiness; 

side of the M2 



Manual Dexterity; 

resemblance that may 

Manual Dexterity; 

resemblance that may 



Linger Dexterity; 

be grasped and moves 

Linger Dexterity; 

be grasped and moves 



Multilimb 

horizontally from front 

Multilimb 

horizontally from front 



Coordination; 

to rear and back to 

Coordination; 

to rear and back to 




front that provides 


front that provides 



PHYSICAL: 

haptic feedback 

PHYSICAL: 

haptic feedback 



Static Strength; Extent 

(pressure and force) 

Static Strength; Extent 

(pressure and force) 
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Flexibility 

similar to that of the 
real weapon 
- Resemblance of bolt 
action moving from 
front to rear of weapon 
when handle engaged 

Flexibility; 

similar to that of the 
real weapon 
- Resemblance of bolt 
action moving from 
front to rear of weapon 
when handle engaged 


Clear Weapon 

a. With bolt locked to 
the rear examine 
chamber and T-Slot 
for rounds 

b. Insert cleaning rod 
into muzzle end of 
barrel and push to 
bore until visible 

c. Remove cleaning 
rod from barrel 

d. Press trigger 

COGNITIVE: 

Inductive Reasoning; 
Problem Sensitivity; 
Information Ordering; 
Spatial Orientation; 
Perceptual Speed; 
Memorization 

SENSORY: 

Night Vision; 

Peripheral Vision; Glare 
Sensitivity; Depth 
Perception; Near 

Vision; 

PSYCHOMOTOR: 

Arm-Hand Steadiness; 
Manual Dexterity; 

Finger Dexterity; 
Multilimb 

Coordination; 

PHYSICAL: 

Extent Flexibility 

- Resemblance of M2 
upper receiver with a 
cover that may be 
opened by turning a 
releasing lever on the 
left side of the cover 

- Resemblance of T-Slot 

- Barrel that a cleaning 
rod may be inserted 
into from the tip to the 
bore to “clear” the 
weapon. 

- Cleaning rod 

- Trigger that affords 
engagement with 
thumbs and haptic 
feedback to trainee 
when thumb pressure 
is applied 

- Wooden block to 
insert inside T-Slot 
once weapon is 
deemed clear 

COGNITIVE: 

Oral Expression; Oral 
Comprehension; 
Deductive Reasoning; 
Inductive Reasoning; 
Problem Sensitivity; 
Information Ordering; 
Spatial Orientation;; 
Perceptual Speed; 
Memorization; 

SENSORY: 

Night Vision; 

Peripheral Vision; 

Depth Perception; Far 
Vision; Near Vision; 
Visual Color 
Discrimination; 

PSYCHOMOTOR: 

Arm-Hand Steadiness; 
Manual Dexterity; 

Finger Dexterity; 
Multilimb 

Coordination; 

PHYSICAL: 

Extent Flexibility 

- Resemblance of M2 
upper receiver with a 
cover that may be 
opened by turning a 
releasing lever on the 
left side of the cover 

- Resemblance of T-Slot 

- Barrel is solid and 
contains laser for EST. 
Not possible to insert 
cleaning rod 

- Trigger that affords 
engagement with 
thumbs and haptic 
feedback to trainee 
when thumb pressure 
is applied 

- No block present since 
weapon cannot be 
cleared lAW FM 

3.22.65 

- No cleaning rod 
present during this 
evaluation 

5 - Excellent 

4 - Very Good 
*3 - Good 

2 - Fair 

1 - Poor 

Post-conditions: Targets engaged per DA Form 7449-R; Engagements completed. 
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